2018-08-16 12:25:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 12:25:24 [DEBUG   ] Got command RPT from MCS: ref #214659
2018-08-16 12:25:24 [DEBUG   ] summary = ERROR
2018-08-16 12:25:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214659  13 58346 44724409 A  ERRORERROR'
2018-08-16 12:25:24 [DEBUG   ] Got command RPT from MCS: ref #214660
2018-08-16 12:25:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:25:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214660  77 58346 44724613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:25:24 [DEBUG   ] Got command RPT from MCS: ref #214661
2018-08-16 12:25:24 [DEBUG   ] summary = ERROR
2018-08-16 12:25:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214661  13 58346 44724817 A  ERRORERROR'
2018-08-16 12:25:25 [DEBUG   ] Got command RPT from MCS: ref #214662
2018-08-16 12:25:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:25:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214662  77 58346 44725021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:25:25 [DEBUG   ] Got command RPT from MCS: ref #214663
2018-08-16 12:25:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 12:25:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214663  12 58346 44725213 A  ERRORB—™š'
2018-08-16 12:25:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 12:25:44 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-08-16 12:25:44 [DEBUG   ] Got command RPT from MCS: ref #214669
2018-08-16 12:25:44 [DEBUG   ] summary = ERROR
2018-08-16 12:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214669  13 58346 44744569 A  ERRORERROR'
2018-08-16 12:25:44 [DEBUG   ] Got command RPT from MCS: ref #214670
2018-08-16 12:25:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214670  77 58346 44744570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:25:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 12:26:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 12:26:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 12:26:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 12:26:43 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-08-16 12:26:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:27:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:27:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:27:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 12:27:43 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-08-16 12:27:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 12:28:18 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 12:28:38 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-16 12:28:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 12:28:43 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-08-16 12:28:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 12:29:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 12:29:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 12:29:44 [DEBUG   ] Finished updating board flags in 2.224 seconds
2018-08-16 12:29:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 12:30:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 12:30:24 [DEBUG   ] Got command RPT from MCS: ref #214690
2018-08-16 12:30:24 [DEBUG   ] summary = ERROR
2018-08-16 12:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214690  13 58346 45024505 A  ERRORERROR'
2018-08-16 12:30:24 [DEBUG   ] Got command RPT from MCS: ref #214691
2018-08-16 12:30:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214691  77 58346 45024709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:30:24 [DEBUG   ] Got command RPT from MCS: ref #214692
2018-08-16 12:30:24 [DEBUG   ] summary = ERROR
2018-08-16 12:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214692  13 58346 45024913 A  ERRORERROR'
2018-08-16 12:30:25 [DEBUG   ] Got command RPT from MCS: ref #214693
2018-08-16 12:30:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:30:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214693  77 58346 45025117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:30:25 [DEBUG   ] Got command RPT from MCS: ref #214694
2018-08-16 12:30:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 12:30:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214694  12 58346 45025309 A  ERRORB–™š'
2018-08-16 12:30:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:30:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 12:30:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 12:30:44 [DEBUG   ] Got command RPT from MCS: ref #214695
2018-08-16 12:30:44 [DEBUG   ] summary = ERROR
2018-08-16 12:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214695  13 58346 45044577 A  ERRORERROR'
2018-08-16 12:30:44 [DEBUG   ] Got command RPT from MCS: ref #214696
2018-08-16 12:30:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214696  77 58346 45044578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:30:44 [DEBUG   ] Finished updating board flags in 2.210 seconds
2018-08-16 12:30:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:31:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:31:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:31:44 [DEBUG   ] Finished updating board flags in 2.253 seconds
2018-08-16 12:31:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:32:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:32:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:32:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 12:32:44 [DEBUG   ] Finished updating board flags in 2.121 seconds
2018-08-16 12:32:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:33:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:33:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:33:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 12:33:44 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-08-16 12:33:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:34:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:34:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:34:44 [DEBUG   ] Finished updating board flags in 1.942 seconds
2018-08-16 12:34:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:35:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:35:24 [DEBUG   ] Got command RPT from MCS: ref #214722
2018-08-16 12:35:24 [DEBUG   ] summary = ERROR
2018-08-16 12:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214722  13 58346 45324602 A  ERRORERROR'
2018-08-16 12:35:24 [DEBUG   ] Got command RPT from MCS: ref #214723
2018-08-16 12:35:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214723  77 58346 45324806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:35:25 [DEBUG   ] Got command RPT from MCS: ref #214724
2018-08-16 12:35:25 [DEBUG   ] summary = ERROR
2018-08-16 12:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214724  13 58346 45325009 A  ERRORERROR'
2018-08-16 12:35:25 [DEBUG   ] Got command RPT from MCS: ref #214725
2018-08-16 12:35:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214725  77 58346 45325213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:35:25 [DEBUG   ] Got command RPT from MCS: ref #214726
2018-08-16 12:35:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 12:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214726  12 58346 45325406 A  ERRORB—™š'
2018-08-16 12:35:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:35:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 12:35:44 [DEBUG   ] Got command RPT from MCS: ref #214732
2018-08-16 12:35:44 [DEBUG   ] summary = ERROR
2018-08-16 12:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214732  13 58346 45344570 A  ERRORERROR'
2018-08-16 12:35:44 [DEBUG   ] Got command RPT from MCS: ref #214733
2018-08-16 12:35:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214733  77 58346 45344570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:35:44 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-08-16 12:35:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 12:36:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:36:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:36:44 [DEBUG   ] Finished updating board flags in 1.848 seconds
2018-08-16 12:36:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:37:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 12:37:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:37:44 [DEBUG   ] Finished updating board flags in 1.759 seconds
2018-08-16 12:37:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:38:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:38:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 12:38:44 [DEBUG   ] Finished updating board flags in 1.650 seconds
2018-08-16 12:38:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:39:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:39:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:39:44 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-08-16 12:39:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:40:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:40:24 [DEBUG   ] Got command RPT from MCS: ref #214757
2018-08-16 12:40:24 [DEBUG   ] summary = ERROR
2018-08-16 12:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214757  13 58346 45624705 A  ERRORERROR'
2018-08-16 12:40:24 [DEBUG   ] Got command RPT from MCS: ref #214758
2018-08-16 12:40:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214758  77 58346 45624909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:40:25 [DEBUG   ] Got command RPT from MCS: ref #214759
2018-08-16 12:40:25 [DEBUG   ] summary = ERROR
2018-08-16 12:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214759  13 58346 45625113 A  ERRORERROR'
2018-08-16 12:40:25 [DEBUG   ] Got command RPT from MCS: ref #214760
2018-08-16 12:40:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214760  77 58346 45625317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:40:25 [DEBUG   ] Got command RPT from MCS: ref #214761
2018-08-16 12:40:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 12:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214761  12 58346 45625509 A  ERRORB–™š'
2018-08-16 12:40:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:40:44 [DEBUG   ] Got command RPT from MCS: ref #214762
2018-08-16 12:40:44 [DEBUG   ] summary = ERROR
2018-08-16 12:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214762  13 58346 45644574 A  ERRORERROR'
2018-08-16 12:40:44 [DEBUG   ] Got command RPT from MCS: ref #214763
2018-08-16 12:40:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214763  77 58346 45644574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:40:44 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-08-16 12:40:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:41:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:41:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:41:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 12:41:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 12:41:44 [DEBUG   ] Finished updating board flags in 1.528 seconds
2018-08-16 12:41:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:42:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:42:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:42:44 [DEBUG   ] Finished updating board flags in 1.541 seconds
2018-08-16 12:42:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:43:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:43:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:43:45 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-08-16 12:43:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:44:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:44:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:44:45 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-08-16 12:44:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:45:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 12:45:24 [DEBUG   ] Got command RPT from MCS: ref #214785
2018-08-16 12:45:24 [DEBUG   ] summary = ERROR
2018-08-16 12:45:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214785  13 58346 45924810 A  ERRORERROR'
2018-08-16 12:45:25 [DEBUG   ] Got command RPT from MCS: ref #214786
2018-08-16 12:45:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214786  77 58346 45925013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:45:25 [DEBUG   ] Got command RPT from MCS: ref #214787
2018-08-16 12:45:25 [DEBUG   ] summary = ERROR
2018-08-16 12:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214787  13 58346 45925218 A  ERRORERROR'
2018-08-16 12:45:25 [DEBUG   ] Got command RPT from MCS: ref #214788
2018-08-16 12:45:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214788  77 58346 45925410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:45:25 [DEBUG   ] Got command RPT from MCS: ref #214789
2018-08-16 12:45:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 12:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214789  12 58346 45925614 A  ERRORB–™š'
2018-08-16 12:45:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:45:44 [DEBUG   ] Got command RPT from MCS: ref #214795
2018-08-16 12:45:44 [DEBUG   ] summary = ERROR
2018-08-16 12:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214795  13 58346 45944574 A  ERRORERROR'
2018-08-16 12:45:44 [DEBUG   ] Got command RPT from MCS: ref #214796
2018-08-16 12:45:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214796  77 58346 45944574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:45:45 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-08-16 12:45:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:46:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 12:46:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:46:45 [DEBUG   ] Finished updating board flags in 1.923 seconds
2018-08-16 12:46:58 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-16 12:47:18 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-16 12:47:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 12:47:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 12:47:45 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-08-16 12:47:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:48:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:48:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:48:45 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-08-16 12:48:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 12:49:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 12:49:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:49:45 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-16 12:49:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:50:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 12:50:24 [DEBUG   ] Got command RPT from MCS: ref #214820
2018-08-16 12:50:24 [DEBUG   ] summary = ERROR
2018-08-16 12:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214820  13 58346 46224937 A  ERRORERROR'
2018-08-16 12:50:25 [DEBUG   ] Got command RPT from MCS: ref #214821
2018-08-16 12:50:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214821  77 58346 46225129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:50:25 [DEBUG   ] Got command RPT from MCS: ref #214822
2018-08-16 12:50:25 [DEBUG   ] summary = ERROR
2018-08-16 12:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214822  13 58346 46225333 A  ERRORERROR'
2018-08-16 12:50:25 [DEBUG   ] Got command RPT from MCS: ref #214823
2018-08-16 12:50:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214823  77 58346 46225537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:50:25 [DEBUG   ] Got command RPT from MCS: ref #214824
2018-08-16 12:50:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 12:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214824  12 58346 46225741 A  ERRORB—™š'
2018-08-16 12:50:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:50:44 [DEBUG   ] Got command RPT from MCS: ref #214825
2018-08-16 12:50:44 [DEBUG   ] summary = ERROR
2018-08-16 12:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214825  13 58346 46244578 A  ERRORERROR'
2018-08-16 12:50:44 [DEBUG   ] Got command RPT from MCS: ref #214826
2018-08-16 12:50:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214826  77 58346 46244578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:50:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 12:50:45 [DEBUG   ] Finished updating board flags in 1.634 seconds
2018-08-16 12:50:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:51:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:51:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 12:51:45 [DEBUG   ] Finished updating board flags in 1.666 seconds
2018-08-16 12:51:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 12:52:18 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 12:52:39 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-16 12:52:45 [DEBUG   ] Finished updating board flags in 1.480 seconds
2018-08-16 12:52:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 12:53:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 12:53:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 12:53:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 12:53:45 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-08-16 12:53:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 12:54:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:54:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 12:54:45 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-08-16 12:54:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 12:55:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 12:55:25 [DEBUG   ] Got command RPT from MCS: ref #214852
2018-08-16 12:55:25 [DEBUG   ] summary = ERROR
2018-08-16 12:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214852  13 58346 46525021 A  ERRORERROR'
2018-08-16 12:55:25 [DEBUG   ] Got command RPT from MCS: ref #214853
2018-08-16 12:55:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214853  77 58346 46525225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:55:25 [DEBUG   ] Got command RPT from MCS: ref #214854
2018-08-16 12:55:25 [DEBUG   ] summary = ERROR
2018-08-16 12:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214854  13 58346 46525417 A  ERRORERROR'
2018-08-16 12:55:25 [DEBUG   ] Got command RPT from MCS: ref #214855
2018-08-16 12:55:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214855  77 58346 46525621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:55:25 [DEBUG   ] Got command RPT from MCS: ref #214856
2018-08-16 12:55:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 12:55:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214856  12 58346 46525825 A  ERRORB–™š'
2018-08-16 12:55:39 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 12:55:44 [DEBUG   ] Got command RPT from MCS: ref #214862
2018-08-16 12:55:44 [DEBUG   ] summary = ERROR
2018-08-16 12:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214862  13 58346 46544581 A  ERRORERROR'
2018-08-16 12:55:44 [DEBUG   ] Got command RPT from MCS: ref #214863
2018-08-16 12:55:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 12:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214863  77 58346 46544582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 12:55:46 [DEBUG   ] Finished updating board flags in 2.154 seconds
2018-08-16 12:55:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 12:56:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 12:56:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 12:56:46 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-08-16 12:56:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:57:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 12:57:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 12:57:46 [DEBUG   ] Finished updating board flags in 1.946 seconds
2018-08-16 12:57:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 12:58:19 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-16 12:58:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 12:58:46 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-08-16 12:59:00 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-16 12:59:20 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-16 12:59:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 12:59:46 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-08-16 12:59:58 [DEBUG   ] Got command TBN from MCS: ref #214884
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '1', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '2', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-16 12:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   214884   8 58346 46798014 A  ERROR'
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '3', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '4', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '5', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '6', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '7', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '8', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '9', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '10', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '11', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '12', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '13', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '14', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '15', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '16', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '17', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '18', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '19', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '20', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '21', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '22', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '23', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '24', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '25', '1534424399']
2018-08-16 12:59:58 [DEBUG   ] spawn_process: at 2018-08-16 12:59:58 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '26', '1534424399']
2018-08-16 12:59:58 [INFO    ] Finished spawning TBN in 0.051 s
2018-08-16 13:00:00 [DEBUG   ] Finished updating ant stats in 1.135 seconds
2018-08-16 13:00:20 [DEBUG   ] Finished updating ant stats in 1.067 seconds
2018-08-16 13:00:25 [DEBUG   ] Got command RPT from MCS: ref #214886
2018-08-16 13:00:25 [DEBUG   ] summary = ERROR
2018-08-16 13:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214886  13 58346 46825101 A  ERRORERROR'
2018-08-16 13:00:25 [DEBUG   ] Got command RPT from MCS: ref #214887
2018-08-16 13:00:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214887  77 58346 46825305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:00:25 [DEBUG   ] Got command RPT from MCS: ref #214888
2018-08-16 13:00:25 [DEBUG   ] summary = ERROR
2018-08-16 13:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214888  13 58346 46825509 A  ERRORERROR'
2018-08-16 13:00:25 [DEBUG   ] Got command RPT from MCS: ref #214889
2018-08-16 13:00:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214889  77 58346 46825701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:00:26 [DEBUG   ] Got command RPT from MCS: ref #214890
2018-08-16 13:00:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214890  12 58346 46826109 A  ERRORB–™š'
2018-08-16 13:00:40 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-16 13:00:44 [DEBUG   ] Got command RPT from MCS: ref #214891
2018-08-16 13:00:44 [DEBUG   ] summary = ERROR
2018-08-16 13:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214891  13 58346 46844581 A  ERRORERROR'
2018-08-16 13:00:44 [DEBUG   ] Got command RPT from MCS: ref #214892
2018-08-16 13:00:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214892  77 58346 46844582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:00:46 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-08-16 13:01:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 13:01:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 13:01:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 13:01:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 13:01:46 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-08-16 13:02:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 13:02:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 13:02:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 13:02:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 13:02:46 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-16 13:03:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-16 13:03:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:03:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 13:03:46 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-08-16 13:04:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:04:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:04:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:04:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 13:04:46 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-08-16 13:05:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:05:20 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-16 13:05:25 [DEBUG   ] Got command RPT from MCS: ref #214918
2018-08-16 13:05:25 [DEBUG   ] summary = ERROR
2018-08-16 13:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214918  13 58346 47125177 A  ERRORERROR'
2018-08-16 13:05:25 [DEBUG   ] Got command RPT from MCS: ref #214919
2018-08-16 13:05:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214919  77 58346 47125381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:05:25 [DEBUG   ] Got command RPT from MCS: ref #214920
2018-08-16 13:05:25 [DEBUG   ] summary = ERROR
2018-08-16 13:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214920  13 58346 47125585 A  ERRORERROR'
2018-08-16 13:05:25 [DEBUG   ] Got command RPT from MCS: ref #214921
2018-08-16 13:05:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214921  77 58346 47125777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:05:25 [DEBUG   ] Got command RPT from MCS: ref #214922
2018-08-16 13:05:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:05:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214922  12 58346 47125981 A  ERRORB—™š'
2018-08-16 13:05:41 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 13:05:44 [DEBUG   ] Got command RPT from MCS: ref #214928
2018-08-16 13:05:44 [DEBUG   ] summary = ERROR
2018-08-16 13:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214928  13 58346 47144581 A  ERRORERROR'
2018-08-16 13:05:44 [DEBUG   ] Got command RPT from MCS: ref #214929
2018-08-16 13:05:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214929  77 58346 47144582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:05:46 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-08-16 13:06:01 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-16 13:06:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 13:06:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:06:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 13:06:46 [DEBUG   ] Finished updating board flags in 1.339 seconds
2018-08-16 13:07:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 13:07:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:07:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:07:46 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-08-16 13:08:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:08:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:08:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 13:08:47 [DEBUG   ] Finished updating board flags in 2.108 seconds
2018-08-16 13:09:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 13:09:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:09:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:09:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 13:09:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 13:09:47 [DEBUG   ] Finished updating board flags in 1.911 seconds
2018-08-16 13:10:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 13:10:21 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-16 13:10:25 [DEBUG   ] Got command RPT from MCS: ref #214953
2018-08-16 13:10:25 [DEBUG   ] summary = ERROR
2018-08-16 13:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214953  13 58346 47425257 A  ERRORERROR'
2018-08-16 13:10:25 [DEBUG   ] Got command RPT from MCS: ref #214954
2018-08-16 13:10:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214954  77 58346 47425461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:10:25 [DEBUG   ] Got command RPT from MCS: ref #214955
2018-08-16 13:10:25 [DEBUG   ] summary = ERROR
2018-08-16 13:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214955  13 58346 47425653 A  ERRORERROR'
2018-08-16 13:10:25 [DEBUG   ] Got command RPT from MCS: ref #214956
2018-08-16 13:10:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214956  77 58346 47425857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:10:26 [DEBUG   ] Got command RPT from MCS: ref #214957
2018-08-16 13:10:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214957  12 58346 47426061 A  ERRORB–™š'
2018-08-16 13:10:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:10:44 [DEBUG   ] Got command RPT from MCS: ref #214958
2018-08-16 13:10:44 [DEBUG   ] summary = ERROR
2018-08-16 13:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214958  13 58346 47444577 A  ERRORERROR'
2018-08-16 13:10:44 [DEBUG   ] Got command RPT from MCS: ref #214959
2018-08-16 13:10:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214959  77 58346 47444578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:10:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 13:10:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 13:10:47 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-08-16 13:11:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:11:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:11:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:11:47 [DEBUG   ] Finished updating board flags in 1.853 seconds
2018-08-16 13:12:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:12:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:12:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:12:47 [DEBUG   ] Finished updating board flags in 1.745 seconds
2018-08-16 13:13:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 13:13:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:13:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:13:47 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-08-16 13:14:01 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-08-16 13:14:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 13:14:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 13:14:47 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-08-16 13:15:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 13:15:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 13:15:25 [DEBUG   ] Got command RPT from MCS: ref #214981
2018-08-16 13:15:25 [DEBUG   ] summary = ERROR
2018-08-16 13:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214981  13 58346 47725353 A  ERRORERROR'
2018-08-16 13:15:25 [DEBUG   ] Got command RPT from MCS: ref #214982
2018-08-16 13:15:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214982  77 58346 47725557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:15:25 [DEBUG   ] Got command RPT from MCS: ref #214983
2018-08-16 13:15:25 [DEBUG   ] summary = ERROR
2018-08-16 13:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214983  13 58346 47725749 A  ERRORERROR'
2018-08-16 13:15:25 [DEBUG   ] Got command RPT from MCS: ref #214984
2018-08-16 13:15:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:15:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214984  77 58346 47725953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:15:26 [DEBUG   ] Got command RPT from MCS: ref #214985
2018-08-16 13:15:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214985  12 58346 47726157 A  ERRORB—™š'
2018-08-16 13:15:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 13:15:44 [DEBUG   ] Got command RPT from MCS: ref #214991
2018-08-16 13:15:44 [DEBUG   ] summary = ERROR
2018-08-16 13:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214991  13 58346 47744577 A  ERRORERROR'
2018-08-16 13:15:44 [DEBUG   ] Got command RPT from MCS: ref #214992
2018-08-16 13:15:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   214992  77 58346 47744578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:15:47 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-08-16 13:16:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-16 13:16:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:16:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:16:47 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-08-16 13:17:01 [DEBUG   ] Finished updating ant stats in 0.674 seconds
2018-08-16 13:17:21 [DEBUG   ] Finished updating ant stats in 0.528 seconds
2018-08-16 13:17:42 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-16 13:17:47 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-08-16 13:18:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 13:18:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 13:18:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:18:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 13:18:48 [DEBUG   ] Finished updating board flags in 2.229 seconds
2018-08-16 13:19:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 13:19:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:19:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 13:19:48 [DEBUG   ] Finished updating board flags in 2.153 seconds
2018-08-16 13:20:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:20:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:20:25 [DEBUG   ] Got command RPT from MCS: ref #215016
2018-08-16 13:20:25 [DEBUG   ] summary = ERROR
2018-08-16 13:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215016  13 58346 48025449 A  ERRORERROR'
2018-08-16 13:20:25 [DEBUG   ] Got command RPT from MCS: ref #215017
2018-08-16 13:20:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215017  77 58346 48025641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:20:25 [DEBUG   ] Got command RPT from MCS: ref #215018
2018-08-16 13:20:25 [DEBUG   ] summary = ERROR
2018-08-16 13:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215018  13 58346 48025845 A  ERRORERROR'
2018-08-16 13:20:26 [DEBUG   ] Got command RPT from MCS: ref #215019
2018-08-16 13:20:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215019  77 58346 48026049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:20:26 [DEBUG   ] Got command RPT from MCS: ref #215020
2018-08-16 13:20:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215020  12 58346 48026253 A  ERRORB–™š'
2018-08-16 13:20:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:20:44 [DEBUG   ] Got command RPT from MCS: ref #215021
2018-08-16 13:20:44 [DEBUG   ] summary = ERROR
2018-08-16 13:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215021  13 58346 48044577 A  ERRORERROR'
2018-08-16 13:20:44 [DEBUG   ] Got command RPT from MCS: ref #215022
2018-08-16 13:20:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215022  77 58346 48044578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:20:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 13:20:48 [DEBUG   ] Finished updating board flags in 2.062 seconds
2018-08-16 13:21:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:21:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:21:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:21:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 13:21:48 [DEBUG   ] Finished updating board flags in 1.938 seconds
2018-08-16 13:22:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 13:22:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:22:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:22:48 [DEBUG   ] Finished updating board flags in 1.837 seconds
2018-08-16 13:23:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:23:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:23:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 13:23:48 [DEBUG   ] Finished updating board flags in 1.845 seconds
2018-08-16 13:24:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:24:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:24:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:24:48 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-08-16 13:25:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:25:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:25:25 [DEBUG   ] Got command RPT from MCS: ref #215048
2018-08-16 13:25:25 [DEBUG   ] summary = ERROR
2018-08-16 13:25:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215048  13 58346 48325533 A  ERRORERROR'
2018-08-16 13:25:25 [DEBUG   ] Got command RPT from MCS: ref #215049
2018-08-16 13:25:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:25:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215049  77 58346 48325737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:25:25 [DEBUG   ] Got command RPT from MCS: ref #215050
2018-08-16 13:25:25 [DEBUG   ] summary = ERROR
2018-08-16 13:25:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215050  13 58346 48325929 A  ERRORERROR'
2018-08-16 13:25:26 [DEBUG   ] Got command RPT from MCS: ref #215051
2018-08-16 13:25:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215051  77 58346 48326133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:25:26 [DEBUG   ] Got command RPT from MCS: ref #215052
2018-08-16 13:25:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215052  12 58346 48326337 A  ERRORB–™š'
2018-08-16 13:25:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:25:44 [DEBUG   ] Got command RPT from MCS: ref #215058
2018-08-16 13:25:44 [DEBUG   ] summary = ERROR
2018-08-16 13:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215058  13 58346 48344589 A  ERRORERROR'
2018-08-16 13:25:44 [DEBUG   ] Got command RPT from MCS: ref #215059
2018-08-16 13:25:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215059  77 58346 48344590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:25:48 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-08-16 13:26:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:26:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:26:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:26:48 [DEBUG   ] Finished updating board flags in 1.722 seconds
2018-08-16 13:27:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 13:27:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 13:27:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 13:27:48 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-08-16 13:28:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:28:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:28:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:28:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 13:28:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 13:28:48 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-08-16 13:29:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:29:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:29:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:29:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 13:29:48 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-08-16 13:30:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 13:30:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:30:25 [DEBUG   ] Got command RPT from MCS: ref #215079
2018-08-16 13:30:25 [DEBUG   ] summary = ERROR
2018-08-16 13:30:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215079  13 58346 48625621 A  ERRORERROR'
2018-08-16 13:30:25 [DEBUG   ] Got command RPT from MCS: ref #215080
2018-08-16 13:30:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:30:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215080  77 58346 48625813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:30:26 [DEBUG   ] Got command RPT from MCS: ref #215081
2018-08-16 13:30:26 [DEBUG   ] summary = ERROR
2018-08-16 13:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215081  13 58346 48626017 A  ERRORERROR'
2018-08-16 13:30:26 [DEBUG   ] Got command RPT from MCS: ref #215082
2018-08-16 13:30:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215082  77 58346 48626221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:30:26 [DEBUG   ] Got command RPT from MCS: ref #215083
2018-08-16 13:30:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215083  12 58346 48626425 A  ERRORB—™š'
2018-08-16 13:30:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:30:44 [DEBUG   ] Got command RPT from MCS: ref #215084
2018-08-16 13:30:44 [DEBUG   ] summary = ERROR
2018-08-16 13:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215084  13 58346 48644585 A  ERRORERROR'
2018-08-16 13:30:44 [DEBUG   ] Got command RPT from MCS: ref #215085
2018-08-16 13:30:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215085  77 58346 48644586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:30:48 [DEBUG   ] Finished updating board flags in 1.560 seconds
2018-08-16 13:31:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:31:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:31:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 13:31:49 [DEBUG   ] Finished updating board flags in 2.299 seconds
2018-08-16 13:32:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:32:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:32:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:32:49 [DEBUG   ] Finished updating board flags in 2.220 seconds
2018-08-16 13:33:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:33:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:33:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 13:33:49 [DEBUG   ] Finished updating board flags in 2.047 seconds
2018-08-16 13:34:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:34:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:34:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:34:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 13:34:49 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-08-16 13:35:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 13:35:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 13:35:25 [DEBUG   ] Got command RPT from MCS: ref #215111
2018-08-16 13:35:25 [DEBUG   ] summary = ERROR
2018-08-16 13:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215111  13 58346 48925701 A  ERRORERROR'
2018-08-16 13:35:25 [DEBUG   ] Got command RPT from MCS: ref #215112
2018-08-16 13:35:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:35:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215112  77 58346 48925905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:35:26 [DEBUG   ] Got command RPT from MCS: ref #215113
2018-08-16 13:35:26 [DEBUG   ] summary = ERROR
2018-08-16 13:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215113  13 58346 48926109 A  ERRORERROR'
2018-08-16 13:35:26 [DEBUG   ] Got command RPT from MCS: ref #215114
2018-08-16 13:35:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215114  77 58346 48926313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:35:26 [DEBUG   ] Got command RPT from MCS: ref #215115
2018-08-16 13:35:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215115  12 58346 48926505 A  ERRORB–™š'
2018-08-16 13:35:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 13:35:44 [DEBUG   ] Got command RPT from MCS: ref #215121
2018-08-16 13:35:44 [DEBUG   ] summary = ERROR
2018-08-16 13:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215121  13 58346 48944589 A  ERRORERROR'
2018-08-16 13:35:44 [DEBUG   ] Got command RPT from MCS: ref #215122
2018-08-16 13:35:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215122  77 58346 48944590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:35:49 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-08-16 13:36:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-16 13:36:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:36:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:36:49 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-08-16 13:37:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 13:37:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:37:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:37:49 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-08-16 13:38:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:38:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:38:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:38:49 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-08-16 13:39:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:39:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:39:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 13:39:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 13:39:49 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-08-16 13:40:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:40:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:40:25 [DEBUG   ] Got command RPT from MCS: ref #215146
2018-08-16 13:40:25 [DEBUG   ] summary = ERROR
2018-08-16 13:40:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215146  13 58346 49225801 A  ERRORERROR'
2018-08-16 13:40:26 [DEBUG   ] Got command RPT from MCS: ref #215147
2018-08-16 13:40:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215147  77 58346 49226005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:40:26 [DEBUG   ] Got command RPT from MCS: ref #215148
2018-08-16 13:40:26 [DEBUG   ] summary = ERROR
2018-08-16 13:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215148  13 58346 49226209 A  ERRORERROR'
2018-08-16 13:40:26 [DEBUG   ] Got command RPT from MCS: ref #215149
2018-08-16 13:40:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215149  77 58346 49226413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:40:26 [DEBUG   ] Got command RPT from MCS: ref #215150
2018-08-16 13:40:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215150  12 58346 49226605 A  ERRORB•™š'
2018-08-16 13:40:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:40:44 [DEBUG   ] Got command RPT from MCS: ref #215151
2018-08-16 13:40:44 [DEBUG   ] summary = ERROR
2018-08-16 13:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215151  13 58346 49244593 A  ERRORERROR'
2018-08-16 13:40:44 [DEBUG   ] Got command RPT from MCS: ref #215152
2018-08-16 13:40:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215152  77 58346 49244594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:40:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 13:40:49 [DEBUG   ] Finished updating board flags in 1.681 seconds
2018-08-16 13:41:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:41:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:41:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:41:49 [DEBUG   ] Finished updating board flags in 1.479 seconds
2018-08-16 13:42:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:42:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:42:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:42:49 [DEBUG   ] Finished updating board flags in 1.487 seconds
2018-08-16 13:43:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 13:43:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:43:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:43:49 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-08-16 13:44:02 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-16 13:44:23 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-16 13:44:43 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-16 13:44:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 13:44:49 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-08-16 13:45:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:45:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 13:45:25 [DEBUG   ] Got command RPT from MCS: ref #215174
2018-08-16 13:45:25 [DEBUG   ] summary = ERROR
2018-08-16 13:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215174  13 58346 49525889 A  ERRORERROR'
2018-08-16 13:45:26 [DEBUG   ] Got command RPT from MCS: ref #215175
2018-08-16 13:45:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215175  77 58346 49526093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:45:26 [DEBUG   ] Got command RPT from MCS: ref #215176
2018-08-16 13:45:26 [DEBUG   ] summary = ERROR
2018-08-16 13:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215176  13 58346 49526297 A  ERRORERROR'
2018-08-16 13:45:26 [DEBUG   ] Got command RPT from MCS: ref #215177
2018-08-16 13:45:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215177  77 58346 49526489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:45:26 [DEBUG   ] Got command RPT from MCS: ref #215178
2018-08-16 13:45:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215178  12 58346 49526693 A  ERRORB—™š'
2018-08-16 13:45:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:45:44 [DEBUG   ] Got command RPT from MCS: ref #215184
2018-08-16 13:45:44 [DEBUG   ] summary = ERROR
2018-08-16 13:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215184  13 58346 49544589 A  ERRORERROR'
2018-08-16 13:45:44 [DEBUG   ] Got command RPT from MCS: ref #215185
2018-08-16 13:45:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215185  77 58346 49544590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:45:50 [DEBUG   ] Finished updating board flags in 2.158 seconds
2018-08-16 13:46:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:46:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:46:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 13:46:50 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-08-16 13:47:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 13:47:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 13:47:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 13:47:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 13:47:50 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-08-16 13:48:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 13:48:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 13:48:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 13:48:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 13:48:50 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-16 13:49:03 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-16 13:49:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-16 13:49:44 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-16 13:49:50 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-08-16 13:50:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 13:50:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:50:25 [DEBUG   ] Got command RPT from MCS: ref #215209
2018-08-16 13:50:25 [DEBUG   ] summary = ERROR
2018-08-16 13:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215209  13 58346 49825993 A  ERRORERROR'
2018-08-16 13:50:26 [DEBUG   ] Got command RPT from MCS: ref #215210
2018-08-16 13:50:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215210  77 58346 49826185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:50:26 [DEBUG   ] Got command RPT from MCS: ref #215211
2018-08-16 13:50:26 [DEBUG   ] summary = ERROR
2018-08-16 13:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215211  13 58346 49826389 A  ERRORERROR'
2018-08-16 13:50:26 [DEBUG   ] Got command RPT from MCS: ref #215212
2018-08-16 13:50:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215212  77 58346 49826593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:50:26 [DEBUG   ] Got command RPT from MCS: ref #215213
2018-08-16 13:50:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:50:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215213  12 58346 49826797 A  ERRORB–™š'
2018-08-16 13:50:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 13:50:44 [DEBUG   ] Got command RPT from MCS: ref #215214
2018-08-16 13:50:44 [DEBUG   ] summary = ERROR
2018-08-16 13:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215214  13 58346 49844589 A  ERRORERROR'
2018-08-16 13:50:44 [DEBUG   ] Got command RPT from MCS: ref #215215
2018-08-16 13:50:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215215  77 58346 49844590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:50:50 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-16 13:51:04 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 13:51:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 13:51:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:51:50 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-08-16 13:52:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 13:52:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 13:52:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 13:52:50 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-08-16 13:53:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 13:53:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 13:53:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-16 13:53:50 [DEBUG   ] Finished updating board flags in 1.351 seconds
2018-08-16 13:54:04 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2018-08-16 13:54:25 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 13:54:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 13:54:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 13:54:51 [DEBUG   ] Finished updating board flags in 2.069 seconds
2018-08-16 13:55:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:55:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:55:26 [DEBUG   ] Got command RPT from MCS: ref #215241
2018-08-16 13:55:26 [DEBUG   ] summary = ERROR
2018-08-16 13:55:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215241  13 58346 50126069 A  ERRORERROR'
2018-08-16 13:55:26 [DEBUG   ] Got command RPT from MCS: ref #215242
2018-08-16 13:55:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:55:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215242  77 58346 50126273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:55:26 [DEBUG   ] Got command RPT from MCS: ref #215243
2018-08-16 13:55:26 [DEBUG   ] summary = ERROR
2018-08-16 13:55:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215243  13 58346 50126477 A  ERRORERROR'
2018-08-16 13:55:26 [DEBUG   ] Got command RPT from MCS: ref #215244
2018-08-16 13:55:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:55:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215244  77 58346 50126669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:55:26 [DEBUG   ] Got command RPT from MCS: ref #215245
2018-08-16 13:55:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 13:55:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215245  12 58346 50126873 A  ERRORB–™š'
2018-08-16 13:55:44 [DEBUG   ] Got command RPT from MCS: ref #215251
2018-08-16 13:55:44 [DEBUG   ] summary = ERROR
2018-08-16 13:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215251  13 58346 50144594 A  ERRORERROR'
2018-08-16 13:55:44 [DEBUG   ] Got command RPT from MCS: ref #215252
2018-08-16 13:55:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 13:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215252  77 58346 50144594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 13:55:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 13:55:51 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-08-16 13:56:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:56:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:56:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:56:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 13:56:51 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-16 13:57:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:57:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:57:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:57:51 [DEBUG   ] Finished updating board flags in 1.885 seconds
2018-08-16 13:58:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 13:58:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 13:58:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 13:58:51 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-08-16 13:59:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 13:59:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 13:59:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 13:59:51 [DEBUG   ] Finished updating board flags in 1.686 seconds
2018-08-16 13:59:58 [DEBUG   ] Got command TBN from MCS: ref #215273
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '1', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '2', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-16 13:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   215273   8 58346 50398010 A  ERROR'
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '3', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '4', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '5', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '6', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '7', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '8', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '9', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '10', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '11', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '12', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '13', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '14', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '15', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '16', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '17', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '18', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '19', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '20', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '21', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '22', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '23', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '24', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '25', '1534427999']
2018-08-16 13:59:58 [DEBUG   ] spawn_process: at 2018-08-16 13:59:58 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '26', '1534427999']
2018-08-16 13:59:58 [INFO    ] Finished spawning TBN in 0.052 s
2018-08-16 14:00:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 14:00:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 14:00:26 [DEBUG   ] Got command RPT from MCS: ref #215275
2018-08-16 14:00:26 [DEBUG   ] summary = ERROR
2018-08-16 14:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215275  13 58346 50426161 A  ERRORERROR'
2018-08-16 14:00:26 [DEBUG   ] Got command RPT from MCS: ref #215276
2018-08-16 14:00:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215276  77 58346 50426365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:00:26 [DEBUG   ] Got command RPT from MCS: ref #215277
2018-08-16 14:00:26 [DEBUG   ] summary = ERROR
2018-08-16 14:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215277  13 58346 50426569 A  ERRORERROR'
2018-08-16 14:00:26 [DEBUG   ] Got command RPT from MCS: ref #215278
2018-08-16 14:00:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215278  77 58346 50426773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:00:26 [DEBUG   ] Got command RPT from MCS: ref #215279
2018-08-16 14:00:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:00:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215279  12 58346 50426965 A  ERRORB—™š'
2018-08-16 14:00:44 [DEBUG   ] Got command RPT from MCS: ref #215280
2018-08-16 14:00:44 [DEBUG   ] summary = ERROR
2018-08-16 14:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215280  13 58346 50444594 A  ERRORERROR'
2018-08-16 14:00:44 [DEBUG   ] Got command RPT from MCS: ref #215281
2018-08-16 14:00:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215281  77 58346 50444594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:00:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 14:00:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 14:00:51 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-08-16 14:01:05 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-16 14:01:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:01:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 14:01:51 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-08-16 14:02:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 14:02:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:02:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:02:51 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-08-16 14:03:05 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-08-16 14:03:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 14:03:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:03:51 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-08-16 14:04:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:04:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:04:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 14:04:51 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-08-16 14:05:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:05:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:05:26 [DEBUG   ] Got command RPT from MCS: ref #215307
2018-08-16 14:05:26 [DEBUG   ] summary = ERROR
2018-08-16 14:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215307  13 58346 50726249 A  ERRORERROR'
2018-08-16 14:05:26 [DEBUG   ] Got command RPT from MCS: ref #215308
2018-08-16 14:05:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215308  77 58346 50726645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:05:26 [DEBUG   ] Got command RPT from MCS: ref #215309
2018-08-16 14:05:26 [DEBUG   ] summary = ERROR
2018-08-16 14:05:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215309  13 58346 50726849 A  ERRORERROR'
2018-08-16 14:05:27 [DEBUG   ] Got command RPT from MCS: ref #215310
2018-08-16 14:05:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215310  77 58346 50727053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:05:27 [DEBUG   ] Got command RPT from MCS: ref #215312
2018-08-16 14:05:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215312  12 58346 50727245 A  ERRORB—™š'
2018-08-16 14:05:44 [DEBUG   ] Got command RPT from MCS: ref #215317
2018-08-16 14:05:44 [DEBUG   ] summary = ERROR
2018-08-16 14:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215317  13 58346 50744589 A  ERRORERROR'
2018-08-16 14:05:44 [DEBUG   ] Got command RPT from MCS: ref #215318
2018-08-16 14:05:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215318  77 58346 50744590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:05:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 14:05:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 14:05:51 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-16 14:06:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 14:06:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:06:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:06:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 14:06:52 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-08-16 14:07:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:07:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 14:07:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:07:52 [DEBUG   ] Finished updating board flags in 2.302 seconds
2018-08-16 14:08:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:08:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:08:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 14:08:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 14:08:52 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-08-16 14:09:06 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-16 14:09:25 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-16 14:09:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-16 14:09:52 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-08-16 14:10:06 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 14:10:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 14:10:26 [DEBUG   ] Got command RPT from MCS: ref #215342
2018-08-16 14:10:26 [DEBUG   ] summary = ERROR
2018-08-16 14:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215342  13 58346 51026345 A  ERRORERROR'
2018-08-16 14:10:26 [DEBUG   ] Got command RPT from MCS: ref #215343
2018-08-16 14:10:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215343  77 58346 51026549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:10:26 [DEBUG   ] Got command RPT from MCS: ref #215344
2018-08-16 14:10:26 [DEBUG   ] summary = ERROR
2018-08-16 14:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215344  13 58346 51026753 A  ERRORERROR'
2018-08-16 14:10:26 [DEBUG   ] Got command RPT from MCS: ref #215345
2018-08-16 14:10:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:10:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215345  77 58346 51026945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:10:27 [DEBUG   ] Got command RPT from MCS: ref #215346
2018-08-16 14:10:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:10:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215346  12 58346 51027149 A  ERRORB–™š'
2018-08-16 14:10:44 [DEBUG   ] Got command RPT from MCS: ref #215347
2018-08-16 14:10:44 [DEBUG   ] summary = ERROR
2018-08-16 14:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215347  13 58346 51044597 A  ERRORERROR'
2018-08-16 14:10:44 [DEBUG   ] Got command RPT from MCS: ref #215348
2018-08-16 14:10:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215348  77 58346 51044598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:10:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 14:10:52 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-08-16 14:11:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 14:11:26 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-16 14:11:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:11:52 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-08-16 14:12:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 14:12:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 14:12:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:12:52 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-08-16 14:13:06 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-16 14:13:26 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-16 14:13:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:13:52 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-08-16 14:14:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:14:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:14:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 14:14:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 14:14:52 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-08-16 14:15:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 14:15:26 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-16 14:15:26 [DEBUG   ] Got command RPT from MCS: ref #215370
2018-08-16 14:15:26 [DEBUG   ] summary = ERROR
2018-08-16 14:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215370  13 58346 51326441 A  ERRORERROR'
2018-08-16 14:15:26 [DEBUG   ] Got command RPT from MCS: ref #215371
2018-08-16 14:15:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215371  77 58346 51326633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:15:26 [DEBUG   ] Got command RPT from MCS: ref #215372
2018-08-16 14:15:26 [DEBUG   ] summary = ERROR
2018-08-16 14:15:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215372  13 58346 51326837 A  ERRORERROR'
2018-08-16 14:15:27 [DEBUG   ] Got command RPT from MCS: ref #215373
2018-08-16 14:15:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215373  77 58346 51327041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:15:27 [DEBUG   ] Got command RPT from MCS: ref #215374
2018-08-16 14:15:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215374  12 58346 51327245 A  ERRORB—™š'
2018-08-16 14:15:44 [DEBUG   ] Got command RPT from MCS: ref #215380
2018-08-16 14:15:44 [DEBUG   ] summary = ERROR
2018-08-16 14:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215380  13 58346 51344601 A  ERRORERROR'
2018-08-16 14:15:44 [DEBUG   ] Got command RPT from MCS: ref #215381
2018-08-16 14:15:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215381  77 58346 51344602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:15:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-16 14:15:52 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-08-16 14:16:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 14:16:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 14:16:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 14:16:52 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-08-16 14:17:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 14:17:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 14:17:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:17:52 [DEBUG   ] Finished updating board flags in 1.349 seconds
2018-08-16 14:18:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 14:18:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 14:18:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:18:53 [DEBUG   ] Finished updating board flags in 2.074 seconds
2018-08-16 14:19:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:19:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 14:19:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 14:19:53 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-08-16 14:20:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 14:20:26 [DEBUG   ] Got command RPT from MCS: ref #215405
2018-08-16 14:20:26 [DEBUG   ] summary = ERROR
2018-08-16 14:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215405  13 58346 51626529 A  ERRORERROR'
2018-08-16 14:20:26 [DEBUG   ] Got command RPT from MCS: ref #215406
2018-08-16 14:20:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215406  77 58346 51626925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:20:27 [DEBUG   ] Got command RPT from MCS: ref #215407
2018-08-16 14:20:27 [DEBUG   ] summary = ERROR
2018-08-16 14:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215407  13 58346 51627129 A  ERRORERROR'
2018-08-16 14:20:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-16 14:20:27 [DEBUG   ] Got command RPT from MCS: ref #215408
2018-08-16 14:20:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215408  77 58346 51627333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:20:27 [DEBUG   ] Got command RPT from MCS: ref #215409
2018-08-16 14:20:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215409  12 58346 51627525 A  ERRORB—™š'
2018-08-16 14:20:44 [DEBUG   ] Got command RPT from MCS: ref #215410
2018-08-16 14:20:44 [DEBUG   ] summary = ERROR
2018-08-16 14:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215410  13 58346 51644597 A  ERRORERROR'
2018-08-16 14:20:44 [DEBUG   ] Got command RPT from MCS: ref #215411
2018-08-16 14:20:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215411  77 58346 51644598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:20:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:20:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 14:20:53 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-08-16 14:21:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 14:21:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 14:21:48 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-16 14:21:53 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-08-16 14:22:08 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-16 14:22:28 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-16 14:22:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 14:22:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 14:22:53 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-08-16 14:23:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 14:23:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 14:23:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 14:23:53 [DEBUG   ] Finished updating board flags in 1.661 seconds
2018-08-16 14:24:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 14:24:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 14:24:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:24:53 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-08-16 14:25:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 14:25:26 [DEBUG   ] Got command RPT from MCS: ref #215437
2018-08-16 14:25:26 [DEBUG   ] summary = ERROR
2018-08-16 14:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215437  13 58346 51926613 A  ERRORERROR'
2018-08-16 14:25:26 [DEBUG   ] Got command RPT from MCS: ref #215438
2018-08-16 14:25:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:25:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215438  77 58346 51926817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:25:27 [DEBUG   ] Got command RPT from MCS: ref #215439
2018-08-16 14:25:27 [DEBUG   ] summary = ERROR
2018-08-16 14:25:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215439  13 58346 51927021 A  ERRORERROR'
2018-08-16 14:25:27 [DEBUG   ] Got command RPT from MCS: ref #215440
2018-08-16 14:25:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:25:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215440  77 58346 51927213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:25:27 [DEBUG   ] Got command RPT from MCS: ref #215441
2018-08-16 14:25:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:25:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215441  12 58346 51927417 A  ERRORB–™š'
2018-08-16 14:25:28 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 14:25:44 [DEBUG   ] Got command RPT from MCS: ref #215447
2018-08-16 14:25:44 [DEBUG   ] summary = ERROR
2018-08-16 14:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215447  13 58346 51944597 A  ERRORERROR'
2018-08-16 14:25:44 [DEBUG   ] Got command RPT from MCS: ref #215448
2018-08-16 14:25:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215448  77 58346 51944598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:25:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 14:25:53 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-08-16 14:26:08 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-16 14:26:29 [DEBUG   ] Finished updating ant stats in 1.593 seconds
2018-08-16 14:26:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 14:26:53 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-08-16 14:27:09 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-16 14:27:29 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-16 14:27:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 14:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 14:27:53 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-08-16 14:28:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 14:28:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 14:28:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 14:28:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 14:28:53 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-08-16 14:29:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:29:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:29:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 14:29:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 14:29:54 [DEBUG   ] Finished updating board flags in 2.238 seconds
2018-08-16 14:30:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:30:26 [DEBUG   ] Got command RPT from MCS: ref #215468
2018-08-16 14:30:26 [DEBUG   ] summary = ERROR
2018-08-16 14:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215468  13 58346 52226697 A  ERRORERROR'
2018-08-16 14:30:26 [DEBUG   ] Got command RPT from MCS: ref #215469
2018-08-16 14:30:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215469  77 58346 52226901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:30:27 [DEBUG   ] Got command RPT from MCS: ref #215470
2018-08-16 14:30:27 [DEBUG   ] summary = ERROR
2018-08-16 14:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215470  13 58346 52227105 A  ERRORERROR'
2018-08-16 14:30:27 [DEBUG   ] Got command RPT from MCS: ref #215471
2018-08-16 14:30:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215471  77 58346 52227309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:30:27 [DEBUG   ] Got command RPT from MCS: ref #215472
2018-08-16 14:30:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215472  12 58346 52227501 A  ERRORB–™š'
2018-08-16 14:30:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 14:30:44 [DEBUG   ] Got command RPT from MCS: ref #215473
2018-08-16 14:30:44 [DEBUG   ] summary = ERROR
2018-08-16 14:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215473  13 58346 52244605 A  ERRORERROR'
2018-08-16 14:30:44 [DEBUG   ] Got command RPT from MCS: ref #215474
2018-08-16 14:30:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215474  77 58346 52244606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:30:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:30:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 14:30:54 [DEBUG   ] Finished updating board flags in 2.149 seconds
2018-08-16 14:31:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 14:31:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:31:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:31:54 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-08-16 14:32:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:32:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 14:32:49 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-16 14:32:54 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-08-16 14:33:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:33:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 14:33:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 14:33:54 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-08-16 14:34:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:34:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:34:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:34:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 14:34:54 [DEBUG   ] Finished updating board flags in 1.880 seconds
2018-08-16 14:35:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 14:35:26 [DEBUG   ] Got command RPT from MCS: ref #215500
2018-08-16 14:35:26 [DEBUG   ] summary = ERROR
2018-08-16 14:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215500  13 58346 52526789 A  ERRORERROR'
2018-08-16 14:35:26 [DEBUG   ] Got command RPT from MCS: ref #215501
2018-08-16 14:35:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:35:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215501  77 58346 52526985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:35:27 [DEBUG   ] Got command RPT from MCS: ref #215502
2018-08-16 14:35:27 [DEBUG   ] summary = ERROR
2018-08-16 14:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215502  13 58346 52527189 A  ERRORERROR'
2018-08-16 14:35:27 [DEBUG   ] Got command RPT from MCS: ref #215503
2018-08-16 14:35:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215503  77 58346 52527393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:35:27 [DEBUG   ] Got command RPT from MCS: ref #215504
2018-08-16 14:35:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215504  12 58346 52527585 A  ERRORB—™š'
2018-08-16 14:35:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:35:44 [DEBUG   ] Got command RPT from MCS: ref #215510
2018-08-16 14:35:44 [DEBUG   ] summary = ERROR
2018-08-16 14:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215510  13 58346 52544605 A  ERRORERROR'
2018-08-16 14:35:44 [DEBUG   ] Got command RPT from MCS: ref #215511
2018-08-16 14:35:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215511  77 58346 52544606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:35:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:35:54 [DEBUG   ] Finished updating board flags in 1.717 seconds
2018-08-16 14:36:09 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-16 14:36:29 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 14:36:49 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 14:36:54 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-08-16 14:37:10 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 14:37:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 14:37:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 14:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 14:37:54 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-08-16 14:38:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 14:38:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:38:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 14:38:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 14:38:54 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-08-16 14:39:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:39:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:39:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 14:39:54 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-08-16 14:40:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 14:40:26 [DEBUG   ] Got command RPT from MCS: ref #215535
2018-08-16 14:40:26 [DEBUG   ] summary = ERROR
2018-08-16 14:40:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215535  13 58346 52826877 A  ERRORERROR'
2018-08-16 14:40:27 [DEBUG   ] Got command RPT from MCS: ref #215536
2018-08-16 14:40:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:40:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215536  77 58346 52827081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:40:27 [DEBUG   ] Got command RPT from MCS: ref #215537
2018-08-16 14:40:27 [DEBUG   ] summary = ERROR
2018-08-16 14:40:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215537  13 58346 52827285 A  ERRORERROR'
2018-08-16 14:40:27 [DEBUG   ] Got command RPT from MCS: ref #215538
2018-08-16 14:40:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:40:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215538  77 58346 52827489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:40:27 [DEBUG   ] Got command RPT from MCS: ref #215539
2018-08-16 14:40:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:40:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215539  12 58346 52827681 A  ERRORB—™š'
2018-08-16 14:40:30 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-16 14:40:44 [DEBUG   ] Got command RPT from MCS: ref #215540
2018-08-16 14:40:44 [DEBUG   ] summary = ERROR
2018-08-16 14:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215540  13 58346 52844601 A  ERRORERROR'
2018-08-16 14:40:44 [DEBUG   ] Got command RPT from MCS: ref #215541
2018-08-16 14:40:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215541  77 58346 52844602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:40:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:40:54 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-08-16 14:41:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 14:41:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 14:41:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:41:54 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-08-16 14:42:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:42:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 14:42:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-16 14:42:55 [DEBUG   ] Finished updating board flags in 2.199 seconds
2018-08-16 14:43:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:43:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 14:43:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:43:55 [DEBUG   ] Finished updating board flags in 1.946 seconds
2018-08-16 14:44:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 14:44:30 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-16 14:44:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-16 14:44:55 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-08-16 14:45:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 14:45:26 [DEBUG   ] Got command RPT from MCS: ref #215563
2018-08-16 14:45:26 [DEBUG   ] summary = ERROR
2018-08-16 14:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215563  13 58346 53126993 A  ERRORERROR'
2018-08-16 14:45:27 [DEBUG   ] Got command RPT from MCS: ref #215564
2018-08-16 14:45:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215564  77 58346 53127197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:45:27 [DEBUG   ] Got command RPT from MCS: ref #215565
2018-08-16 14:45:27 [DEBUG   ] summary = ERROR
2018-08-16 14:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215565  13 58346 53127389 A  ERRORERROR'
2018-08-16 14:45:27 [DEBUG   ] Got command RPT from MCS: ref #215566
2018-08-16 14:45:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215566  77 58346 53127593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:45:27 [DEBUG   ] Got command RPT from MCS: ref #215567
2018-08-16 14:45:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215567  12 58346 53127797 A  ERRORB•™š'
2018-08-16 14:45:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 14:45:44 [DEBUG   ] Got command RPT from MCS: ref #215573
2018-08-16 14:45:44 [DEBUG   ] summary = ERROR
2018-08-16 14:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215573  13 58346 53144609 A  ERRORERROR'
2018-08-16 14:45:44 [DEBUG   ] Got command RPT from MCS: ref #215574
2018-08-16 14:45:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215574  77 58346 53144610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:45:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 14:45:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 14:45:55 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-08-16 14:46:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 14:46:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 14:46:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:46:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 14:46:55 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-16 14:47:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:47:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 14:47:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 14:47:55 [DEBUG   ] Finished updating board flags in 1.649 seconds
2018-08-16 14:48:11 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-08-16 14:48:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:48:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 14:48:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 14:48:55 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-08-16 14:49:11 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2018-08-16 14:49:31 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-16 14:49:52 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-16 14:49:55 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-08-16 14:50:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-16 14:50:27 [DEBUG   ] Got command RPT from MCS: ref #215598
2018-08-16 14:50:27 [DEBUG   ] summary = ERROR
2018-08-16 14:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215598  13 58346 53427077 A  ERRORERROR'
2018-08-16 14:50:27 [DEBUG   ] Got command RPT from MCS: ref #215599
2018-08-16 14:50:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215599  77 58346 53427281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:50:27 [DEBUG   ] Got command RPT from MCS: ref #215600
2018-08-16 14:50:27 [DEBUG   ] summary = ERROR
2018-08-16 14:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215600  13 58346 53427473 A  ERRORERROR'
2018-08-16 14:50:27 [DEBUG   ] Got command RPT from MCS: ref #215601
2018-08-16 14:50:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215601  77 58346 53427677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:50:27 [DEBUG   ] Got command RPT from MCS: ref #215602
2018-08-16 14:50:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:50:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215602  12 58346 53427881 A  ERRORB—™š'
2018-08-16 14:50:32 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 14:50:44 [DEBUG   ] Got command RPT from MCS: ref #215603
2018-08-16 14:50:44 [DEBUG   ] summary = ERROR
2018-08-16 14:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215603  13 58346 53444609 A  ERRORERROR'
2018-08-16 14:50:44 [DEBUG   ] Got command RPT from MCS: ref #215604
2018-08-16 14:50:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215604  77 58346 53444610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:50:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 14:50:55 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-16 14:51:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 14:51:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 14:51:52 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 14:51:55 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-08-16 14:52:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 14:52:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 14:52:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 14:52:56 [DEBUG   ] Finished updating board flags in 2.220 seconds
2018-08-16 14:53:12 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-16 14:53:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 14:53:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:53:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 14:53:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 14:53:56 [DEBUG   ] Finished updating board flags in 2.181 seconds
2018-08-16 14:54:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 14:54:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:54:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 14:54:56 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-08-16 14:55:12 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-16 14:55:27 [DEBUG   ] Got command RPT from MCS: ref #215630
2018-08-16 14:55:27 [DEBUG   ] summary = ERROR
2018-08-16 14:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215630  13 58346 53727157 A  ERRORERROR'
2018-08-16 14:55:27 [DEBUG   ] Got command RPT from MCS: ref #215631
2018-08-16 14:55:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215631  77 58346 53727361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:55:27 [DEBUG   ] Got command RPT from MCS: ref #215632
2018-08-16 14:55:27 [DEBUG   ] summary = ERROR
2018-08-16 14:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215632  13 58346 53727565 A  ERRORERROR'
2018-08-16 14:55:27 [DEBUG   ] Got command RPT from MCS: ref #215633
2018-08-16 14:55:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215633  77 58346 53727769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:55:27 [DEBUG   ] Got command RPT from MCS: ref #215634
2018-08-16 14:55:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 14:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215634  12 58346 53727961 A  ERRORB—™š'
2018-08-16 14:55:33 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 14:55:44 [DEBUG   ] Got command RPT from MCS: ref #215640
2018-08-16 14:55:44 [DEBUG   ] summary = ERROR
2018-08-16 14:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215640  13 58346 53744605 A  ERRORERROR'
2018-08-16 14:55:44 [DEBUG   ] Got command RPT from MCS: ref #215641
2018-08-16 14:55:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 14:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215641  77 58346 53744606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 14:55:53 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-16 14:55:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 14:55:56 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-08-16 14:56:13 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2018-08-16 14:56:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 14:56:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-16 14:56:56 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-08-16 14:57:13 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-16 14:57:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:57:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:57:56 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-08-16 14:58:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:58:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 14:58:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:58:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 14:58:56 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-08-16 14:59:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:59:34 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2018-08-16 14:59:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 14:59:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 14:59:56 [DEBUG   ] Finished updating board flags in 1.686 seconds
2018-08-16 14:59:58 [DEBUG   ] Got command TBN from MCS: ref #215662
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '1', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '2', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-16 14:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   215662   8 58346 53998014 A  ERROR'
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '3', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '4', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '5', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '6', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '7', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '8', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '9', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '10', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '11', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '12', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '13', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '14', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '15', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '16', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '17', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '18', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '19', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '20', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '21', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '22', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '23', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '24', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '25', '1534431599']
2018-08-16 14:59:58 [DEBUG   ] spawn_process: at 2018-08-16 14:59:58 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '34000000.0', '7', '20', '0', '26', '1534431599']
2018-08-16 14:59:58 [INFO    ] Finished spawning TBN in 0.053 s
2018-08-16 15:00:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:00:27 [DEBUG   ] Got command RPT from MCS: ref #215664
2018-08-16 15:00:27 [DEBUG   ] summary = ERROR
2018-08-16 15:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215664  13 58346 54027237 A  ERRORERROR'
2018-08-16 15:00:27 [DEBUG   ] Got command RPT from MCS: ref #215665
2018-08-16 15:00:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215665  77 58346 54027441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:00:27 [DEBUG   ] Got command RPT from MCS: ref #215666
2018-08-16 15:00:27 [DEBUG   ] summary = ERROR
2018-08-16 15:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215666  13 58346 54027645 A  ERRORERROR'
2018-08-16 15:00:27 [DEBUG   ] Got command RPT from MCS: ref #215667
2018-08-16 15:00:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:00:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215667  77 58346 54027849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:00:28 [DEBUG   ] Got command RPT from MCS: ref #215668
2018-08-16 15:00:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215668  12 58346 54028041 A  ERRORB—™š'
2018-08-16 15:00:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:00:44 [DEBUG   ] Got command RPT from MCS: ref #215669
2018-08-16 15:00:44 [DEBUG   ] summary = ERROR
2018-08-16 15:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215669  13 58346 54044605 A  ERRORERROR'
2018-08-16 15:00:44 [DEBUG   ] Got command RPT from MCS: ref #215670
2018-08-16 15:00:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215670  77 58346 54044606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:00:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:00:56 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-08-16 15:01:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 15:01:34 [DEBUG   ] Finished updating ant stats in 1.600 seconds
2018-08-16 15:01:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:01:56 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-08-16 15:02:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:02:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:02:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:02:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 15:02:56 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-08-16 15:03:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:03:34 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2018-08-16 15:03:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:03:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 15:03:57 [DEBUG   ] Finished updating board flags in 2.181 seconds
2018-08-16 15:04:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 15:04:33 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-16 15:04:54 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 15:04:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 15:04:57 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-08-16 15:05:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 15:05:27 [DEBUG   ] Got command RPT from MCS: ref #215696
2018-08-16 15:05:27 [DEBUG   ] summary = ERROR
2018-08-16 15:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215696  13 58346 54327333 A  ERRORERROR'
2018-08-16 15:05:27 [DEBUG   ] Got command RPT from MCS: ref #215697
2018-08-16 15:05:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215697  77 58346 54327537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:05:27 [DEBUG   ] Got command RPT from MCS: ref #215698
2018-08-16 15:05:27 [DEBUG   ] summary = ERROR
2018-08-16 15:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215698  13 58346 54327729 A  ERRORERROR'
2018-08-16 15:05:27 [DEBUG   ] Got command RPT from MCS: ref #215699
2018-08-16 15:05:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:05:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215699  77 58346 54327933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:05:28 [DEBUG   ] Got command RPT from MCS: ref #215700
2018-08-16 15:05:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215700  12 58346 54328137 A  ERRORB–™š'
2018-08-16 15:05:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:05:44 [DEBUG   ] Got command RPT from MCS: ref #215706
2018-08-16 15:05:44 [DEBUG   ] summary = ERROR
2018-08-16 15:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215706  13 58346 54344609 A  ERRORERROR'
2018-08-16 15:05:44 [DEBUG   ] Got command RPT from MCS: ref #215707
2018-08-16 15:05:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215707  77 58346 54344610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:05:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:05:57 [DEBUG   ] Finished updating board flags in 1.952 seconds
2018-08-16 15:06:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:06:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 15:06:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 15:06:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 15:06:57 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-16 15:07:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 15:07:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 15:07:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 15:07:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 15:07:57 [DEBUG   ] Finished updating board flags in 1.684 seconds
2018-08-16 15:08:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 15:08:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 15:08:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 15:08:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 15:08:57 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-08-16 15:09:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-16 15:09:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 15:09:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 15:09:57 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-08-16 15:10:14 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-08-16 15:10:27 [DEBUG   ] Got command RPT from MCS: ref #215731
2018-08-16 15:10:27 [DEBUG   ] summary = ERROR
2018-08-16 15:10:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215731  13 58346 54627421 A  ERRORERROR'
2018-08-16 15:10:27 [DEBUG   ] Got command RPT from MCS: ref #215732
2018-08-16 15:10:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:10:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215732  77 58346 54627625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:10:27 [DEBUG   ] Got command RPT from MCS: ref #215733
2018-08-16 15:10:27 [DEBUG   ] summary = ERROR
2018-08-16 15:10:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215733  13 58346 54627822 A  ERRORERROR'
2018-08-16 15:10:28 [DEBUG   ] Got command RPT from MCS: ref #215734
2018-08-16 15:10:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215734  77 58346 54628025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:10:28 [DEBUG   ] Got command RPT from MCS: ref #215735
2018-08-16 15:10:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215735  12 58346 54628217 A  ERRORB–™š'
2018-08-16 15:10:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 15:10:44 [DEBUG   ] Got command RPT from MCS: ref #215736
2018-08-16 15:10:44 [DEBUG   ] summary = ERROR
2018-08-16 15:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215736  13 58346 54644613 A  ERRORERROR'
2018-08-16 15:10:44 [DEBUG   ] Got command RPT from MCS: ref #215737
2018-08-16 15:10:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215737  77 58346 54644614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:10:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 15:10:57 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-08-16 15:11:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:11:34 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-16 15:11:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-16 15:11:57 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-08-16 15:12:15 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-16 15:12:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 15:12:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 15:12:58 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-08-16 15:13:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 15:13:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 15:13:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 15:13:58 [DEBUG   ] Finished updating board flags in 2.186 seconds
2018-08-16 15:14:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 15:14:35 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-16 15:14:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:14:58 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-08-16 15:15:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 15:15:27 [DEBUG   ] Got command RPT from MCS: ref #215759
2018-08-16 15:15:27 [DEBUG   ] summary = ERROR
2018-08-16 15:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215759  13 58346 54927505 A  ERRORERROR'
2018-08-16 15:15:27 [DEBUG   ] Got command RPT from MCS: ref #215760
2018-08-16 15:15:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215760  77 58346 54927709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:15:27 [DEBUG   ] Got command RPT from MCS: ref #215761
2018-08-16 15:15:27 [DEBUG   ] summary = ERROR
2018-08-16 15:15:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215761  13 58346 54927901 A  ERRORERROR'
2018-08-16 15:15:28 [DEBUG   ] Got command RPT from MCS: ref #215762
2018-08-16 15:15:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215762  77 58346 54928105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:15:28 [DEBUG   ] Got command RPT from MCS: ref #215763
2018-08-16 15:15:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215763  12 58346 54928309 A  ERRORB—™š'
2018-08-16 15:15:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:15:44 [DEBUG   ] Got command RPT from MCS: ref #215769
2018-08-16 15:15:44 [DEBUG   ] summary = ERROR
2018-08-16 15:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215769  13 58346 54944605 A  ERRORERROR'
2018-08-16 15:15:44 [DEBUG   ] Got command RPT from MCS: ref #215770
2018-08-16 15:15:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215770  77 58346 54944606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:15:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 15:15:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 15:15:58 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-08-16 15:16:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:16:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 15:16:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 15:16:58 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-08-16 15:17:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 15:17:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:17:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 15:17:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 15:17:58 [DEBUG   ] Finished updating board flags in 1.881 seconds
2018-08-16 15:18:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 15:18:36 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-16 15:18:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 15:18:58 [DEBUG   ] Finished updating board flags in 1.696 seconds
2018-08-16 15:19:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 15:19:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 15:19:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 15:19:58 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-16 15:20:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:20:27 [DEBUG   ] Got command RPT from MCS: ref #215794
2018-08-16 15:20:27 [DEBUG   ] summary = ERROR
2018-08-16 15:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215794  13 58346 55227601 A  ERRORERROR'
2018-08-16 15:20:27 [DEBUG   ] Got command RPT from MCS: ref #215795
2018-08-16 15:20:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:20:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215795  77 58346 55227805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:20:28 [DEBUG   ] Got command RPT from MCS: ref #215796
2018-08-16 15:20:28 [DEBUG   ] summary = ERROR
2018-08-16 15:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215796  13 58346 55228009 A  ERRORERROR'
2018-08-16 15:20:28 [DEBUG   ] Got command RPT from MCS: ref #215797
2018-08-16 15:20:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215797  77 58346 55228201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:20:28 [DEBUG   ] Got command RPT from MCS: ref #215798
2018-08-16 15:20:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215798  12 58346 55228405 A  ERRORB—™š'
2018-08-16 15:20:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:20:44 [DEBUG   ] Got command RPT from MCS: ref #215799
2018-08-16 15:20:44 [DEBUG   ] summary = ERROR
2018-08-16 15:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215799  13 58346 55244605 A  ERRORERROR'
2018-08-16 15:20:44 [DEBUG   ] Got command RPT from MCS: ref #215800
2018-08-16 15:20:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215800  77 58346 55244606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:20:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:20:58 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-08-16 15:21:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:21:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:21:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 15:21:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 15:21:58 [DEBUG   ] Finished updating board flags in 1.662 seconds
2018-08-16 15:22:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 15:22:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 15:22:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 15:22:58 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-08-16 15:23:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 15:23:36 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-16 15:23:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 15:23:58 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-08-16 15:24:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 15:24:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 15:24:56 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-16 15:24:58 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-08-16 15:25:17 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-16 15:25:27 [DEBUG   ] Got command RPT from MCS: ref #215826
2018-08-16 15:25:27 [DEBUG   ] summary = ERROR
2018-08-16 15:25:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215826  13 58346 55527697 A  ERRORERROR'
2018-08-16 15:25:27 [DEBUG   ] Got command RPT from MCS: ref #215827
2018-08-16 15:25:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:25:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215827  77 58346 55527889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:25:28 [DEBUG   ] Got command RPT from MCS: ref #215828
2018-08-16 15:25:28 [DEBUG   ] summary = ERROR
2018-08-16 15:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215828  13 58346 55528094 A  ERRORERROR'
2018-08-16 15:25:28 [DEBUG   ] Got command RPT from MCS: ref #215829
2018-08-16 15:25:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215829  77 58346 55528297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:25:28 [DEBUG   ] Got command RPT from MCS: ref #215830
2018-08-16 15:25:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215830  12 58346 55528501 A  ERRORB–™š'
2018-08-16 15:25:37 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 15:25:44 [DEBUG   ] Got command RPT from MCS: ref #215836
2018-08-16 15:25:44 [DEBUG   ] summary = ERROR
2018-08-16 15:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215836  13 58346 55544617 A  ERRORERROR'
2018-08-16 15:25:44 [DEBUG   ] Got command RPT from MCS: ref #215837
2018-08-16 15:25:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215837  77 58346 55544618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:25:57 [DEBUG   ] Finished updating ant stats in 1.242 seconds
2018-08-16 15:25:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 15:25:58 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-08-16 15:26:17 [DEBUG   ] Finished updating ant stats in 1.161 seconds
2018-08-16 15:26:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 15:26:57 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-08-16 15:26:58 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-08-16 15:27:17 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-16 15:27:37 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-16 15:27:57 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 15:27:58 [DEBUG   ] Finished updating board flags in 1.343 seconds
2018-08-16 15:28:18 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 15:28:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 15:28:58 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2018-08-16 15:28:59 [DEBUG   ] Finished updating board flags in 2.070 seconds
2018-08-16 15:29:18 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-08-16 15:29:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 15:29:58 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-08-16 15:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 15:29:59 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-08-16 15:30:18 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2018-08-16 15:30:27 [DEBUG   ] Got command RPT from MCS: ref #215857
2018-08-16 15:30:27 [DEBUG   ] summary = ERROR
2018-08-16 15:30:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215857  13 58346 55827797 A  ERRORERROR'
2018-08-16 15:30:28 [DEBUG   ] Got command RPT from MCS: ref #215858
2018-08-16 15:30:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215858  77 58346 55828010 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:30:28 [DEBUG   ] Got command RPT from MCS: ref #215859
2018-08-16 15:30:28 [DEBUG   ] summary = ERROR
2018-08-16 15:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215859  13 58346 55828201 A  ERRORERROR'
2018-08-16 15:30:28 [DEBUG   ] Got command RPT from MCS: ref #215860
2018-08-16 15:30:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215860  77 58346 55828405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:30:28 [DEBUG   ] Got command RPT from MCS: ref #215861
2018-08-16 15:30:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215861  12 58346 55828597 A  ERRORB•™š'
2018-08-16 15:30:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:30:44 [DEBUG   ] Got command RPT from MCS: ref #215862
2018-08-16 15:30:44 [DEBUG   ] summary = ERROR
2018-08-16 15:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215862  13 58346 55844617 A  ERRORERROR'
2018-08-16 15:30:44 [DEBUG   ] Got command RPT from MCS: ref #215863
2018-08-16 15:30:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215863  77 58346 55844618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:30:58 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2018-08-16 15:30:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 15:30:59 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-08-16 15:31:18 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-08-16 15:31:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 15:31:58 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-08-16 15:31:59 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-08-16 15:32:18 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2018-08-16 15:32:38 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 15:32:58 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-08-16 15:32:59 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-08-16 15:33:19 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2018-08-16 15:33:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 15:33:59 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2018-08-16 15:33:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 15:33:59 [DEBUG   ] Finished updating board flags in 1.659 seconds
2018-08-16 15:34:19 [DEBUG   ] Finished updating ant stats in 1.161 seconds
2018-08-16 15:34:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 15:34:59 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-08-16 15:34:59 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-08-16 15:35:19 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-08-16 15:35:27 [DEBUG   ] Got command RPT from MCS: ref #215889
2018-08-16 15:35:27 [DEBUG   ] summary = ERROR
2018-08-16 15:35:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215889  13 58346 56127885 A  ERRORERROR'
2018-08-16 15:35:28 [DEBUG   ] Got command RPT from MCS: ref #215890
2018-08-16 15:35:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:35:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215890  77 58346 56128293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:35:28 [DEBUG   ] Got command RPT from MCS: ref #215891
2018-08-16 15:35:28 [DEBUG   ] summary = ERROR
2018-08-16 15:35:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215891  13 58346 56128485 A  ERRORERROR'
2018-08-16 15:35:28 [DEBUG   ] Got command RPT from MCS: ref #215893
2018-08-16 15:35:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:35:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215893  77 58346 56128893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:35:29 [DEBUG   ] Got command RPT from MCS: ref #215894
2018-08-16 15:35:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:35:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215894  12 58346 56129289 A  ERRORB–™š'
2018-08-16 15:35:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:35:44 [DEBUG   ] Got command RPT from MCS: ref #215899
2018-08-16 15:35:44 [DEBUG   ] summary = ERROR
2018-08-16 15:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215899  13 58346 56144617 A  ERRORERROR'
2018-08-16 15:35:44 [DEBUG   ] Got command RPT from MCS: ref #215900
2018-08-16 15:35:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215900  77 58346 56144618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:35:59 [DEBUG   ] Finished updating ant stats in 0.836 seconds
2018-08-16 15:35:59 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-16 15:36:19 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2018-08-16 15:36:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 15:36:59 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2018-08-16 15:36:59 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-08-16 15:37:20 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2018-08-16 15:37:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 15:38:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 15:38:00 [DEBUG   ] Finished updating board flags in 2.359 seconds
2018-08-16 15:38:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-16 15:38:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 15:39:00 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-08-16 15:39:00 [DEBUG   ] Finished updating board flags in 2.151 seconds
2018-08-16 15:39:20 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-16 15:39:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 15:40:00 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2018-08-16 15:40:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 15:40:00 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-08-16 15:40:20 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-08-16 15:40:27 [DEBUG   ] Got command RPT from MCS: ref #215924
2018-08-16 15:40:27 [DEBUG   ] summary = ERROR
2018-08-16 15:40:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215924  13 58346 56427973 A  ERRORERROR'
2018-08-16 15:40:28 [DEBUG   ] Got command RPT from MCS: ref #215925
2018-08-16 15:40:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215925  77 58346 56428177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:40:28 [DEBUG   ] Got command RPT from MCS: ref #215926
2018-08-16 15:40:28 [DEBUG   ] summary = ERROR
2018-08-16 15:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215926  13 58346 56428381 A  ERRORERROR'
2018-08-16 15:40:28 [DEBUG   ] Got command RPT from MCS: ref #215927
2018-08-16 15:40:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215927  77 58346 56428573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:40:28 [DEBUG   ] Got command RPT from MCS: ref #215928
2018-08-16 15:40:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215928  12 58346 56428777 A  ERRORB—™š'
2018-08-16 15:40:40 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 15:40:44 [DEBUG   ] Got command RPT from MCS: ref #215929
2018-08-16 15:40:44 [DEBUG   ] summary = ERROR
2018-08-16 15:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215929  13 58346 56444613 A  ERRORERROR'
2018-08-16 15:40:44 [DEBUG   ] Got command RPT from MCS: ref #215930
2018-08-16 15:40:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215930  77 58346 56444614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:41:00 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2018-08-16 15:41:00 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-08-16 15:41:21 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2018-08-16 15:41:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:42:00 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-08-16 15:42:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 15:42:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:42:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 15:43:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 15:43:01 [DEBUG   ] Finished updating board flags in 2.908 seconds
2018-08-16 15:43:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:43:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 15:43:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 15:44:00 [DEBUG   ] Finished updating board flags in 1.696 seconds
2018-08-16 15:44:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 15:44:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:44:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 15:45:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 15:45:00 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-08-16 15:45:01 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 15:45:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 15:45:28 [DEBUG   ] Got command RPT from MCS: ref #215952
2018-08-16 15:45:28 [DEBUG   ] summary = ERROR
2018-08-16 15:45:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215952  13 58346 56728085 A  ERRORERROR'
2018-08-16 15:45:28 [DEBUG   ] Got command RPT from MCS: ref #215953
2018-08-16 15:45:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:45:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215953  77 58346 56728277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:45:28 [DEBUG   ] Got command RPT from MCS: ref #215954
2018-08-16 15:45:28 [DEBUG   ] summary = ERROR
2018-08-16 15:45:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215954  13 58346 56728490 A  ERRORERROR'
2018-08-16 15:45:28 [DEBUG   ] Got command RPT from MCS: ref #215955
2018-08-16 15:45:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:45:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215955  77 58346 56728681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:45:28 [DEBUG   ] Got command RPT from MCS: ref #215956
2018-08-16 15:45:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:45:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215956  12 58346 56728885 A  ERRORB—™š'
2018-08-16 15:45:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 15:45:44 [DEBUG   ] Got command RPT from MCS: ref #215962
2018-08-16 15:45:44 [DEBUG   ] summary = ERROR
2018-08-16 15:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215962  13 58346 56744621 A  ERRORERROR'
2018-08-16 15:45:44 [DEBUG   ] Got command RPT from MCS: ref #215963
2018-08-16 15:45:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215963  77 58346 56744622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:46:00 [DEBUG   ] Finished updating board flags in 1.648 seconds
2018-08-16 15:46:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 15:46:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 15:46:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 15:46:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 15:47:00 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-08-16 15:47:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 15:47:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:47:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 15:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 15:48:00 [DEBUG   ] Finished updating board flags in 1.539 seconds
2018-08-16 15:48:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 15:48:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:48:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 15:49:01 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-08-16 15:49:01 [DEBUG   ] Finished updating board flags in 2.292 seconds
2018-08-16 15:49:21 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-16 15:49:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:50:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 15:50:01 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-08-16 15:50:01 [DEBUG   ] Finished updating board flags in 2.149 seconds
2018-08-16 15:50:21 [DEBUG   ] Finished updating ant stats in 0.553 seconds
2018-08-16 15:50:28 [DEBUG   ] Got command RPT from MCS: ref #215987
2018-08-16 15:50:28 [DEBUG   ] summary = ERROR
2018-08-16 15:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215987  13 58346 57028173 A  ERRORERROR'
2018-08-16 15:50:28 [DEBUG   ] Got command RPT from MCS: ref #215988
2018-08-16 15:50:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215988  77 58346 57028377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:50:28 [DEBUG   ] Got command RPT from MCS: ref #215989
2018-08-16 15:50:28 [DEBUG   ] summary = ERROR
2018-08-16 15:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215989  13 58346 57028581 A  ERRORERROR'
2018-08-16 15:50:28 [DEBUG   ] Got command RPT from MCS: ref #215990
2018-08-16 15:50:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215990  77 58346 57028773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:50:28 [DEBUG   ] Got command RPT from MCS: ref #215991
2018-08-16 15:50:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215991  12 58346 57028977 A  ERRORB—™š'
2018-08-16 15:50:41 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-16 15:50:44 [DEBUG   ] Got command RPT from MCS: ref #215992
2018-08-16 15:50:44 [DEBUG   ] summary = ERROR
2018-08-16 15:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215992  13 58346 57044621 A  ERRORERROR'
2018-08-16 15:50:44 [DEBUG   ] Got command RPT from MCS: ref #215993
2018-08-16 15:50:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   215993  77 58346 57044622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:51:01 [DEBUG   ] Finished updating ant stats in 0.444 seconds
2018-08-16 15:51:01 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-08-16 15:51:22 [DEBUG   ] Finished updating ant stats in 1.354 seconds
2018-08-16 15:51:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 15:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 15:52:01 [DEBUG   ] Finished updating board flags in 1.960 seconds
2018-08-16 15:52:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 15:52:22 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-16 15:52:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 15:53:01 [DEBUG   ] Finished updating board flags in 1.857 seconds
2018-08-16 15:53:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 15:53:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 15:53:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 15:54:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 15:54:01 [DEBUG   ] Finished updating board flags in 1.757 seconds
2018-08-16 15:54:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 15:54:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 15:54:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 15:55:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 15:55:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 15:55:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 15:55:01 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-08-16 15:55:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-16 15:55:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 15:55:28 [DEBUG   ] Got command RPT from MCS: ref #216019
2018-08-16 15:55:28 [DEBUG   ] summary = ERROR
2018-08-16 15:55:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216019  13 58346 57328281 A  ERRORERROR'
2018-08-16 15:55:28 [DEBUG   ] Got command RPT from MCS: ref #216020
2018-08-16 15:55:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:55:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216020  77 58346 57328485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:55:28 [DEBUG   ] Got command RPT from MCS: ref #216021
2018-08-16 15:55:28 [DEBUG   ] summary = ERROR
2018-08-16 15:55:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216021  13 58346 57328689 A  ERRORERROR'
2018-08-16 15:55:28 [DEBUG   ] Got command RPT from MCS: ref #216022
2018-08-16 15:55:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:55:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216022  77 58346 57328893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:55:29 [DEBUG   ] Got command RPT from MCS: ref #216023
2018-08-16 15:55:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 15:55:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216023  12 58346 57329085 A  ERRORB–™š'
2018-08-16 15:55:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:55:44 [DEBUG   ] Got command RPT from MCS: ref #216029
2018-08-16 15:55:44 [DEBUG   ] summary = ERROR
2018-08-16 15:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216029  13 58346 57344617 A  ERRORERROR'
2018-08-16 15:55:44 [DEBUG   ] Got command RPT from MCS: ref #216030
2018-08-16 15:55:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 15:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216030  77 58346 57344618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 15:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 15:56:01 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-08-16 15:56:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:56:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 15:56:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 15:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 15:57:01 [DEBUG   ] Finished updating board flags in 1.652 seconds
2018-08-16 15:57:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 15:57:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 15:57:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 15:58:01 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-08-16 15:58:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 15:58:22 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-16 15:58:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 15:59:01 [DEBUG   ] Finished updating board flags in 1.549 seconds
2018-08-16 15:59:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 15:59:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 15:59:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 16:00:02 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-08-16 16:00:02 [DEBUG   ] Finished updating board flags in 2.300 seconds
2018-08-16 16:00:22 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-08-16 16:00:28 [DEBUG   ] Got command RPT from MCS: ref #216050
2018-08-16 16:00:28 [DEBUG   ] summary = ERROR
2018-08-16 16:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216050  13 58346 57628381 A  ERRORERROR'
2018-08-16 16:00:28 [DEBUG   ] Got command RPT from MCS: ref #216051
2018-08-16 16:00:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216051  77 58346 57628789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:00:28 [DEBUG   ] Got command RPT from MCS: ref #216052
2018-08-16 16:00:28 [DEBUG   ] summary = ERROR
2018-08-16 16:00:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216052  13 58346 57628981 A  ERRORERROR'
2018-08-16 16:00:29 [DEBUG   ] Got command RPT from MCS: ref #216053
2018-08-16 16:00:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:00:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216053  77 58346 57629185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:00:29 [DEBUG   ] Got command RPT from MCS: ref #216054
2018-08-16 16:00:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:00:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216054  12 58346 57629389 A  ERRORB–™š'
2018-08-16 16:00:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-16 16:00:44 [DEBUG   ] Got command RPT from MCS: ref #216055
2018-08-16 16:00:44 [DEBUG   ] summary = ERROR
2018-08-16 16:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216055  13 58346 57644617 A  ERRORERROR'
2018-08-16 16:00:44 [DEBUG   ] Got command RPT from MCS: ref #216056
2018-08-16 16:00:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216056  77 58346 57644618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:01:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 16:01:02 [DEBUG   ] Finished updating board flags in 2.145 seconds
2018-08-16 16:01:03 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-16 16:01:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 16:01:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:02:02 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-08-16 16:02:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:02:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:02:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 16:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 16:03:02 [DEBUG   ] Finished updating board flags in 1.831 seconds
2018-08-16 16:03:03 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-16 16:03:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-16 16:03:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 16:04:00 [DEBUG   ] Got command TBN from MCS: ref #216123
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-16 16:04:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   216123   8 58346 57840021 A  ERROR'
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1534435441']
2018-08-16 16:04:00 [DEBUG   ] spawn_process: at 2018-08-16 16:04:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1534435441']
2018-08-16 16:04:00 [INFO    ] Finished spawning TBN in 0.055 s
2018-08-16 16:04:01 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-08-16 16:04:03 [DEBUG   ] Finished updating ant stats in 0.736 seconds
2018-08-16 16:04:23 [DEBUG   ] Finished updating ant stats in 0.667 seconds
2018-08-16 16:04:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 16:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 16:05:02 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-08-16 16:05:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 16:05:24 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-08-16 16:05:28 [DEBUG   ] Got command RPT from MCS: ref #216130
2018-08-16 16:05:28 [DEBUG   ] summary = ERROR
2018-08-16 16:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216130  13 58346 57928469 A  ERRORERROR'
2018-08-16 16:05:28 [DEBUG   ] Got command RPT from MCS: ref #216131
2018-08-16 16:05:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216131  77 58346 57928673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:05:28 [DEBUG   ] Got command RPT from MCS: ref #216132
2018-08-16 16:05:28 [DEBUG   ] summary = ERROR
2018-08-16 16:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216132  13 58346 57928877 A  ERRORERROR'
2018-08-16 16:05:29 [DEBUG   ] Got command RPT from MCS: ref #216133
2018-08-16 16:05:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216133  77 58346 57929081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:05:29 [DEBUG   ] Got command RPT from MCS: ref #216134
2018-08-16 16:05:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216134  12 58346 57929273 A  ERRORB™™š'
2018-08-16 16:05:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 16:05:44 [DEBUG   ] Got command RPT from MCS: ref #216140
2018-08-16 16:05:44 [DEBUG   ] summary = ERROR
2018-08-16 16:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216140  13 58346 57944625 A  ERRORERROR'
2018-08-16 16:05:44 [DEBUG   ] Got command RPT from MCS: ref #216141
2018-08-16 16:05:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216141  77 58346 57944626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:06:02 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-08-16 16:06:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-16 16:06:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 16:06:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 16:07:02 [DEBUG   ] Finished updating board flags in 1.347 seconds
2018-08-16 16:07:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 16:07:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-16 16:07:44 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 16:08:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-08-16 16:08:02 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-08-16 16:08:04 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 16:08:11 [DEBUG   ] Got command TBW from MCS: ref #216162
2018-08-16 16:08:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-08-16 16:08:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   216162   8 58346 58091342 A  ERROR'
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-08-16 16:08:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-08-16 16:08:14 [DEBUG   ] spawn_process: at 2018-08-16 16:08:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-08-16 16:08:14 [INFO    ] Finished spawning TBW
2018-08-16 16:09:03 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-08-16 16:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-08-16 16:10:02 [INFO    ] __waitForTBW - TBW finished in 107.929 s
2018-08-16 16:10:03 [DEBUG   ] Finished updating ant stats in 0.520 seconds
2018-08-16 16:10:03 [DEBUG   ] Finished updating board flags in 1.699 seconds
2018-08-16 16:10:03 [INFO    ] Started antennas statistics background thread
2018-08-16 16:10:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1534435805']
2018-08-16 16:10:03 [DEBUG   ] spawn_process: at 2018-08-16 16:10:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1534435805']
2018-08-16 16:10:03 [INFO    ] Finished spawning TBN in 0.051 s
2018-08-16 16:10:23 [DEBUG   ] Finished updating ant stats in 0.438 seconds
2018-08-16 16:10:28 [DEBUG   ] Got command RPT from MCS: ref #216172
2018-08-16 16:10:28 [DEBUG   ] summary = ERROR
2018-08-16 16:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216172  13 58346 58228585 A  ERRORERROR'
2018-08-16 16:10:28 [DEBUG   ] Got command RPT from MCS: ref #216173
2018-08-16 16:10:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216173  77 58346 58228789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:10:28 [DEBUG   ] Got command RPT from MCS: ref #216174
2018-08-16 16:10:28 [DEBUG   ] summary = ERROR
2018-08-16 16:10:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216174  13 58346 58228993 A  ERRORERROR'
2018-08-16 16:10:29 [DEBUG   ] Got command RPT from MCS: ref #216175
2018-08-16 16:10:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:10:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216175  77 58346 58229197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:10:29 [DEBUG   ] Got command RPT from MCS: ref #216176
2018-08-16 16:10:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:10:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216176  12 58346 58229389 A  ERRORBœ™š'
2018-08-16 16:10:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-16 16:10:44 [DEBUG   ] Got command RPT from MCS: ref #216179
2018-08-16 16:10:44 [DEBUG   ] summary = ERROR
2018-08-16 16:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216179  13 58346 58244629 A  ERRORERROR'
2018-08-16 16:10:44 [DEBUG   ] Got command RPT from MCS: ref #216180
2018-08-16 16:10:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216180  77 58346 58244630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:11:03 [DEBUG   ] Finished updating ant stats in 0.457 seconds
2018-08-16 16:11:03 [DEBUG   ] Finished updating board flags in 1.836 seconds
2018-08-16 16:11:24 [DEBUG   ] Finished updating ant stats in 1.345 seconds
2018-08-16 16:11:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 16:12:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 16:12:03 [DEBUG   ] Finished updating board flags in 1.759 seconds
2018-08-16 16:12:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:12:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:12:44 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 16:13:03 [DEBUG   ] Finished updating board flags in 1.577 seconds
2018-08-16 16:13:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:13:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:13:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:14:03 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-08-16 16:14:04 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-16 16:14:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 16:14:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 16:15:03 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-08-16 16:15:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 16:15:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 16:15:28 [DEBUG   ] Got command RPT from MCS: ref #216202
2018-08-16 16:15:28 [DEBUG   ] summary = ERROR
2018-08-16 16:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216202  13 58346 58528677 A  ERRORERROR'
2018-08-16 16:15:28 [DEBUG   ] Got command RPT from MCS: ref #216203
2018-08-16 16:15:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:15:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216203  77 58346 58528881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:15:29 [DEBUG   ] Got command RPT from MCS: ref #216204
2018-08-16 16:15:29 [DEBUG   ] summary = ERROR
2018-08-16 16:15:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216204  13 58346 58529085 A  ERRORERROR'
2018-08-16 16:15:29 [DEBUG   ] Got command RPT from MCS: ref #216205
2018-08-16 16:15:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:15:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216205  77 58346 58529277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:15:29 [DEBUG   ] Got command RPT from MCS: ref #216206
2018-08-16 16:15:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:15:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216206  12 58346 58529481 A  ERRORB›™š'
2018-08-16 16:15:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 16:15:44 [DEBUG   ] Got command RPT from MCS: ref #216212
2018-08-16 16:15:44 [DEBUG   ] summary = ERROR
2018-08-16 16:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216212  13 58346 58544629 A  ERRORERROR'
2018-08-16 16:15:44 [DEBUG   ] Got command RPT from MCS: ref #216213
2018-08-16 16:15:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216213  77 58346 58544630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 16:16:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 16:16:03 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-08-16 16:16:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 16:16:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 16:16:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 16:17:03 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-08-16 16:17:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 16:17:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 16:17:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 16:18:04 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2018-08-16 16:18:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 16:18:04 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-08-16 16:18:24 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-08-16 16:18:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 16:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 16:19:04 [DEBUG   ] Finished updating ant stats in 0.641 seconds
2018-08-16 16:19:04 [DEBUG   ] Finished updating board flags in 2.191 seconds
2018-08-16 16:19:24 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-08-16 16:19:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-16 16:20:04 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-08-16 16:20:05 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 16:20:25 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 16:20:28 [DEBUG   ] Got command RPT from MCS: ref #216237
2018-08-16 16:20:28 [DEBUG   ] summary = ERROR
2018-08-16 16:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216237  13 58346 58828765 A  ERRORERROR'
2018-08-16 16:20:28 [DEBUG   ] Got command RPT from MCS: ref #216238
2018-08-16 16:20:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:20:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216238  77 58346 58828969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:20:29 [DEBUG   ] Got command RPT from MCS: ref #216239
2018-08-16 16:20:29 [DEBUG   ] summary = ERROR
2018-08-16 16:20:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216239  13 58346 58829173 A  ERRORERROR'
2018-08-16 16:20:29 [DEBUG   ] Got command RPT from MCS: ref #216240
2018-08-16 16:20:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:20:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216240  77 58346 58829377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:20:29 [DEBUG   ] Got command RPT from MCS: ref #216241
2018-08-16 16:20:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:20:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216241  12 58346 58829569 A  ERRORB›™š'
2018-08-16 16:20:44 [DEBUG   ] Got command RPT from MCS: ref #216242
2018-08-16 16:20:44 [DEBUG   ] summary = ERROR
2018-08-16 16:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216242  13 58346 58844654 A  ERRORERROR'
2018-08-16 16:20:44 [DEBUG   ] Got command RPT from MCS: ref #216243
2018-08-16 16:20:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216243  77 58346 58844654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:20:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:21:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 16:21:05 [DEBUG   ] Finished updating board flags in 3.035 seconds
2018-08-16 16:21:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 16:21:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:22:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 16:22:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 16:22:04 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-08-16 16:22:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 16:22:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 16:22:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 16:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 16:23:04 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-08-16 16:23:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 16:23:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 16:23:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 16:24:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 16:24:04 [DEBUG   ] Finished updating board flags in 1.760 seconds
2018-08-16 16:24:05 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-16 16:24:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 16:24:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 16:25:04 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-08-16 16:25:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 16:25:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 16:25:28 [DEBUG   ] Got command RPT from MCS: ref #216281
2018-08-16 16:25:28 [DEBUG   ] summary = ERROR
2018-08-16 16:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216281  13 58346 59128849 A  ERRORERROR'
2018-08-16 16:25:29 [DEBUG   ] Got command RPT from MCS: ref #216282
2018-08-16 16:25:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216282  77 58346 59129053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:25:29 [DEBUG   ] Got command RPT from MCS: ref #216283
2018-08-16 16:25:29 [DEBUG   ] summary = ERROR
2018-08-16 16:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216283  13 58346 59129461 A  ERRORERROR'
2018-08-16 16:25:29 [DEBUG   ] Got command RPT from MCS: ref #216284
2018-08-16 16:25:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216284  77 58346 59129654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:25:29 [DEBUG   ] Got command RPT from MCS: ref #216286
2018-08-16 16:25:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216286  12 58346 59129857 A  ERRORBš™š'
2018-08-16 16:25:44 [DEBUG   ] Got command RPT from MCS: ref #216291
2018-08-16 16:25:44 [DEBUG   ] summary = ERROR
2018-08-16 16:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216291  13 58346 59144653 A  ERRORERROR'
2018-08-16 16:25:44 [DEBUG   ] Got command RPT from MCS: ref #216292
2018-08-16 16:25:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216292  77 58346 59144654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:25:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 16:26:04 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-16 16:26:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 16:26:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 16:26:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 16:27:04 [DEBUG   ] Finished updating board flags in 1.547 seconds
2018-08-16 16:27:05 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-16 16:27:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-16 16:27:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 16:28:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 16:28:04 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-08-16 16:28:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:28:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:28:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 16:29:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 16:29:05 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-08-16 16:29:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 16:29:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:29:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:30:05 [DEBUG   ] Finished updating board flags in 2.163 seconds
2018-08-16 16:30:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:30:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:30:28 [DEBUG   ] Got command RPT from MCS: ref #216312
2018-08-16 16:30:28 [DEBUG   ] summary = ERROR
2018-08-16 16:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216312  13 58346 59428961 A  ERRORERROR'
2018-08-16 16:30:29 [DEBUG   ] Got command RPT from MCS: ref #216313
2018-08-16 16:30:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216313  77 58346 59429165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:30:29 [DEBUG   ] Got command RPT from MCS: ref #216314
2018-08-16 16:30:29 [DEBUG   ] summary = ERROR
2018-08-16 16:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216314  13 58346 59429357 A  ERRORERROR'
2018-08-16 16:30:29 [DEBUG   ] Got command RPT from MCS: ref #216315
2018-08-16 16:30:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216315  77 58346 59429561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:30:29 [DEBUG   ] Got command RPT from MCS: ref #216316
2018-08-16 16:30:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216316  12 58346 59429765 A  ERRORBš™š'
2018-08-16 16:30:44 [DEBUG   ] Got command RPT from MCS: ref #216317
2018-08-16 16:30:44 [DEBUG   ] summary = ERROR
2018-08-16 16:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216317  13 58346 59444657 A  ERRORERROR'
2018-08-16 16:30:44 [DEBUG   ] Got command RPT from MCS: ref #216318
2018-08-16 16:30:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216318  77 58346 59444658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:30:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 16:31:05 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-08-16 16:31:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 16:31:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 16:31:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:32:05 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-08-16 16:32:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:32:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:32:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:33:05 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-08-16 16:33:06 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-16 16:33:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 16:33:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 16:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 16:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 16:34:05 [DEBUG   ] Finished updating board flags in 1.733 seconds
2018-08-16 16:34:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:34:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 16:34:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:35:05 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-08-16 16:35:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 16:35:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 16:35:29 [DEBUG   ] Got command RPT from MCS: ref #216344
2018-08-16 16:35:29 [DEBUG   ] summary = ERROR
2018-08-16 16:35:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216344  13 58346 59729049 A  ERRORERROR'
2018-08-16 16:35:29 [DEBUG   ] Got command RPT from MCS: ref #216345
2018-08-16 16:35:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:35:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216345  77 58346 59729445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:35:29 [DEBUG   ] Got command RPT from MCS: ref #216346
2018-08-16 16:35:29 [DEBUG   ] summary = ERROR
2018-08-16 16:35:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216346  13 58346 59729649 A  ERRORERROR'
2018-08-16 16:35:29 [DEBUG   ] Got command RPT from MCS: ref #216347
2018-08-16 16:35:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:35:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216347  77 58346 59729853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:35:30 [DEBUG   ] Got command RPT from MCS: ref #216349
2018-08-16 16:35:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216349  12 58346 59730045 A  ERRORB™™š'
2018-08-16 16:35:44 [DEBUG   ] Got command RPT from MCS: ref #216354
2018-08-16 16:35:44 [DEBUG   ] summary = ERROR
2018-08-16 16:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216354  13 58346 59744649 A  ERRORERROR'
2018-08-16 16:35:44 [DEBUG   ] Got command RPT from MCS: ref #216355
2018-08-16 16:35:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216355  77 58346 59744650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:35:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 16:36:05 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-08-16 16:36:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 16:36:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 16:36:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 16:37:05 [DEBUG   ] Finished updating board flags in 1.559 seconds
2018-08-16 16:37:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 16:37:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 16:37:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 16:38:06 [DEBUG   ] Finished updating board flags in 1.564 seconds
2018-08-16 16:38:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 16:38:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 16:38:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 16:39:06 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-08-16 16:39:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 16:39:06 [DEBUG   ] Finished updating board flags in 2.150 seconds
2018-08-16 16:39:26 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-08-16 16:39:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 16:40:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 16:40:06 [DEBUG   ] Finished updating board flags in 2.234 seconds
2018-08-16 16:40:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-16 16:40:29 [DEBUG   ] Got command RPT from MCS: ref #216379
2018-08-16 16:40:29 [DEBUG   ] summary = ERROR
2018-08-16 16:40:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216379  13 58346 60029145 A  ERRORERROR'
2018-08-16 16:40:29 [DEBUG   ] Got command RPT from MCS: ref #216380
2018-08-16 16:40:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:40:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216380  77 58346 60029350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:40:29 [DEBUG   ] Got command RPT from MCS: ref #216381
2018-08-16 16:40:29 [DEBUG   ] summary = ERROR
2018-08-16 16:40:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216381  13 58346 60029541 A  ERRORERROR'
2018-08-16 16:40:29 [DEBUG   ] Got command RPT from MCS: ref #216382
2018-08-16 16:40:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:40:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216382  77 58346 60029745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:40:29 [DEBUG   ] Got command RPT from MCS: ref #216383
2018-08-16 16:40:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:40:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216383  12 58346 60029949 A  ERRORB™™š'
2018-08-16 16:40:44 [DEBUG   ] Got command RPT from MCS: ref #216384
2018-08-16 16:40:44 [DEBUG   ] summary = ERROR
2018-08-16 16:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216384  13 58346 60044649 A  ERRORERROR'
2018-08-16 16:40:44 [DEBUG   ] Got command RPT from MCS: ref #216385
2018-08-16 16:40:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216385  77 58346 60044650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:40:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 16:41:06 [DEBUG   ] Finished updating ant stats in 0.652 seconds
2018-08-16 16:41:06 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-08-16 16:41:26 [DEBUG   ] Finished updating ant stats in 0.550 seconds
2018-08-16 16:41:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-16 16:42:06 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2018-08-16 16:42:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 16:42:06 [DEBUG   ] Finished updating board flags in 1.918 seconds
2018-08-16 16:42:27 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2018-08-16 16:42:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:43:06 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-08-16 16:43:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:43:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:43:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:44:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 16:44:06 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-08-16 16:44:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:44:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:44:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 16:45:06 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-08-16 16:45:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:45:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:45:29 [DEBUG   ] Got command RPT from MCS: ref #216407
2018-08-16 16:45:29 [DEBUG   ] summary = ERROR
2018-08-16 16:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216407  13 58346 60329229 A  ERRORERROR'
2018-08-16 16:45:29 [DEBUG   ] Got command RPT from MCS: ref #216408
2018-08-16 16:45:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216408  77 58346 60329433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:45:29 [DEBUG   ] Got command RPT from MCS: ref #216409
2018-08-16 16:45:29 [DEBUG   ] summary = ERROR
2018-08-16 16:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216409  13 58346 60329625 A  ERRORERROR'
2018-08-16 16:45:29 [DEBUG   ] Got command RPT from MCS: ref #216410
2018-08-16 16:45:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:45:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216410  77 58346 60329829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:45:30 [DEBUG   ] Got command RPT from MCS: ref #216411
2018-08-16 16:45:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216411  12 58346 60330033 A  ERRORB™™š'
2018-08-16 16:45:44 [DEBUG   ] Got command RPT from MCS: ref #216417
2018-08-16 16:45:44 [DEBUG   ] summary = ERROR
2018-08-16 16:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216417  13 58346 60344649 A  ERRORERROR'
2018-08-16 16:45:44 [DEBUG   ] Got command RPT from MCS: ref #216418
2018-08-16 16:45:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216418  77 58346 60344650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:45:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 16:46:06 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-08-16 16:46:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:46:27 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-16 16:46:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:47:06 [DEBUG   ] Finished updating board flags in 1.460 seconds
2018-08-16 16:47:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:47:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:47:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:48:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-08-16 16:48:06 [DEBUG   ] Finished updating board flags in 1.553 seconds
2018-08-16 16:48:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:48:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:48:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 16:49:07 [DEBUG   ] Finished updating ant stats in 1.055 seconds
2018-08-16 16:49:07 [DEBUG   ] Finished updating board flags in 2.279 seconds
2018-08-16 16:49:27 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2018-08-16 16:49:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 16:50:07 [DEBUG   ] Finished updating ant stats in 0.856 seconds
2018-08-16 16:50:07 [DEBUG   ] Finished updating board flags in 2.213 seconds
2018-08-16 16:50:27 [DEBUG   ] Finished updating ant stats in 0.745 seconds
2018-08-16 16:50:29 [DEBUG   ] Got command RPT from MCS: ref #216442
2018-08-16 16:50:29 [DEBUG   ] summary = ERROR
2018-08-16 16:50:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216442  13 58346 60629321 A  ERRORERROR'
2018-08-16 16:50:29 [DEBUG   ] Got command RPT from MCS: ref #216443
2018-08-16 16:50:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:50:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216443  77 58346 60629525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:50:29 [DEBUG   ] Got command RPT from MCS: ref #216444
2018-08-16 16:50:29 [DEBUG   ] summary = ERROR
2018-08-16 16:50:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216444  13 58346 60629717 A  ERRORERROR'
2018-08-16 16:50:29 [DEBUG   ] Got command RPT from MCS: ref #216445
2018-08-16 16:50:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:50:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216445  77 58346 60629921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:50:30 [DEBUG   ] Got command RPT from MCS: ref #216446
2018-08-16 16:50:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216446  12 58346 60630125 A  ERRORBœ™š'
2018-08-16 16:50:44 [DEBUG   ] Got command RPT from MCS: ref #216447
2018-08-16 16:50:44 [DEBUG   ] summary = ERROR
2018-08-16 16:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216447  13 58346 60644657 A  ERRORERROR'
2018-08-16 16:50:44 [DEBUG   ] Got command RPT from MCS: ref #216448
2018-08-16 16:50:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216448  77 58346 60644658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:50:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 16:51:07 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-08-16 16:51:07 [DEBUG   ] Finished updating board flags in 2.079 seconds
2018-08-16 16:51:27 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2018-08-16 16:51:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 16:52:07 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-08-16 16:52:07 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-08-16 16:52:28 [DEBUG   ] Finished updating ant stats in 1.353 seconds
2018-08-16 16:52:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 16:53:07 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-08-16 16:53:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 16:53:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 16:53:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 16:54:07 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-08-16 16:54:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 16:54:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:54:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:55:07 [DEBUG   ] Finished updating board flags in 1.756 seconds
2018-08-16 16:55:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 16:55:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 16:55:29 [DEBUG   ] Got command RPT from MCS: ref #216474
2018-08-16 16:55:29 [DEBUG   ] summary = ERROR
2018-08-16 16:55:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216474  13 58346 60929417 A  ERRORERROR'
2018-08-16 16:55:29 [DEBUG   ] Got command RPT from MCS: ref #216475
2018-08-16 16:55:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:55:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216475  77 58346 60929813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:55:30 [DEBUG   ] Got command RPT from MCS: ref #216476
2018-08-16 16:55:30 [DEBUG   ] summary = ERROR
2018-08-16 16:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216476  13 58346 60930017 A  ERRORERROR'
2018-08-16 16:55:30 [DEBUG   ] Got command RPT from MCS: ref #216477
2018-08-16 16:55:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216477  77 58346 60930209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:55:30 [DEBUG   ] Got command RPT from MCS: ref #216479
2018-08-16 16:55:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 16:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216479  12 58346 60930413 A  ERRORBœ™š'
2018-08-16 16:55:44 [DEBUG   ] Got command RPT from MCS: ref #216484
2018-08-16 16:55:44 [DEBUG   ] summary = ERROR
2018-08-16 16:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216484  13 58346 60944657 A  ERRORERROR'
2018-08-16 16:55:44 [DEBUG   ] Got command RPT from MCS: ref #216485
2018-08-16 16:55:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 16:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216485  77 58346 60944658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 16:55:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:56:07 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-08-16 16:56:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:56:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 16:56:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:57:07 [DEBUG   ] Finished updating board flags in 1.692 seconds
2018-08-16 16:57:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:57:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:57:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 16:58:07 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-08-16 16:58:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:58:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 16:58:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:59:07 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-08-16 16:59:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 16:59:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 16:59:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 17:00:08 [DEBUG   ] Finished updating ant stats in 1.053 seconds
2018-08-16 17:00:08 [DEBUG   ] Finished updating board flags in 2.296 seconds
2018-08-16 17:00:28 [DEBUG   ] Finished updating ant stats in 0.946 seconds
2018-08-16 17:00:29 [DEBUG   ] Got command RPT from MCS: ref #216505
2018-08-16 17:00:29 [DEBUG   ] summary = ERROR
2018-08-16 17:00:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216505  13 58346 61229493 A  ERRORERROR'
2018-08-16 17:00:29 [DEBUG   ] Got command RPT from MCS: ref #216506
2018-08-16 17:00:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:00:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216506  77 58346 61229697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:00:29 [DEBUG   ] Got command RPT from MCS: ref #216507
2018-08-16 17:00:29 [DEBUG   ] summary = ERROR
2018-08-16 17:00:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216507  13 58346 61229901 A  ERRORERROR'
2018-08-16 17:00:30 [DEBUG   ] Got command RPT from MCS: ref #216508
2018-08-16 17:00:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216508  77 58346 61230093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:00:30 [DEBUG   ] Got command RPT from MCS: ref #216509
2018-08-16 17:00:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216509  12 58346 61230297 A  ERRORB›™š'
2018-08-16 17:00:44 [DEBUG   ] Got command RPT from MCS: ref #216510
2018-08-16 17:00:44 [DEBUG   ] summary = ERROR
2018-08-16 17:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216510  13 58346 61244653 A  ERRORERROR'
2018-08-16 17:00:44 [DEBUG   ] Got command RPT from MCS: ref #216511
2018-08-16 17:00:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216511  77 58346 61244654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:00:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 17:01:08 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2018-08-16 17:01:08 [DEBUG   ] Finished updating board flags in 2.113 seconds
2018-08-16 17:01:28 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-08-16 17:01:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 17:02:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 17:02:08 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-08-16 17:02:08 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-08-16 17:02:28 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-08-16 17:02:49 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-16 17:03:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 17:03:08 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-08-16 17:03:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 17:03:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 17:03:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 17:04:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 17:04:08 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-08-16 17:04:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 17:04:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 17:04:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 17:05:08 [DEBUG   ] Finished updating board flags in 1.951 seconds
2018-08-16 17:05:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:05:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:05:29 [DEBUG   ] Got command RPT from MCS: ref #216537
2018-08-16 17:05:29 [DEBUG   ] summary = ERROR
2018-08-16 17:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216537  13 58346 61529601 A  ERRORERROR'
2018-08-16 17:05:29 [DEBUG   ] Got command RPT from MCS: ref #216538
2018-08-16 17:05:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216538  77 58346 61529793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:05:29 [DEBUG   ] Got command RPT from MCS: ref #216539
2018-08-16 17:05:29 [DEBUG   ] summary = ERROR
2018-08-16 17:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216539  13 58346 61529997 A  ERRORERROR'
2018-08-16 17:05:30 [DEBUG   ] Got command RPT from MCS: ref #216540
2018-08-16 17:05:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216540  77 58346 61530214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:05:30 [DEBUG   ] Got command RPT from MCS: ref #216541
2018-08-16 17:05:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216541  12 58346 61530393 A  ERRORB›™š'
2018-08-16 17:05:44 [DEBUG   ] Got command RPT from MCS: ref #216547
2018-08-16 17:05:44 [DEBUG   ] summary = ERROR
2018-08-16 17:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216547  13 58346 61544661 A  ERRORERROR'
2018-08-16 17:05:44 [DEBUG   ] Got command RPT from MCS: ref #216548
2018-08-16 17:05:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216548  77 58346 61544662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:05:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 17:06:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:06:09 [DEBUG   ] Finished updating board flags in 2.711 seconds
2018-08-16 17:06:29 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-16 17:06:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 17:07:08 [DEBUG   ] Finished updating board flags in 1.695 seconds
2018-08-16 17:07:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 17:07:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 17:07:49 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-16 17:08:08 [DEBUG   ] Finished updating board flags in 1.563 seconds
2018-08-16 17:08:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 17:08:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-16 17:08:50 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 17:09:08 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-16 17:09:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 17:09:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 17:09:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 17:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 17:10:08 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-08-16 17:10:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:10:29 [DEBUG   ] Got command RPT from MCS: ref #216572
2018-08-16 17:10:29 [DEBUG   ] summary = ERROR
2018-08-16 17:10:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216572  13 58346 61829698 A  ERRORERROR'
2018-08-16 17:10:29 [DEBUG   ] Got command RPT from MCS: ref #216573
2018-08-16 17:10:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:10:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216573  77 58346 61829902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:10:30 [DEBUG   ] Got command RPT from MCS: ref #216574
2018-08-16 17:10:30 [DEBUG   ] summary = ERROR
2018-08-16 17:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216574  13 58346 61830105 A  ERRORERROR'
2018-08-16 17:10:30 [DEBUG   ] Got command RPT from MCS: ref #216575
2018-08-16 17:10:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216575  77 58346 61830310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:10:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 17:10:30 [DEBUG   ] Got command RPT from MCS: ref #216576
2018-08-16 17:10:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216576  12 58346 61830502 A  ERRORBš™š'
2018-08-16 17:10:44 [DEBUG   ] Got command RPT from MCS: ref #216577
2018-08-16 17:10:44 [DEBUG   ] summary = ERROR
2018-08-16 17:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216577  13 58346 61844661 A  ERRORERROR'
2018-08-16 17:10:44 [DEBUG   ] Got command RPT from MCS: ref #216578
2018-08-16 17:10:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216578  77 58346 61844662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:10:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 17:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 17:11:08 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-08-16 17:11:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:11:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:11:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 17:12:08 [DEBUG   ] Finished updating board flags in 1.483 seconds
2018-08-16 17:12:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-16 17:12:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:12:50 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-16 17:13:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 17:13:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 17:13:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 17:13:09 [DEBUG   ] Finished updating board flags in 2.217 seconds
2018-08-16 17:13:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 17:13:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 17:13:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 17:14:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 17:14:09 [DEBUG   ] Finished updating board flags in 2.132 seconds
2018-08-16 17:14:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 17:14:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 17:14:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 17:15:09 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-08-16 17:15:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 17:15:29 [DEBUG   ] Got command RPT from MCS: ref #216600
2018-08-16 17:15:29 [DEBUG   ] summary = ERROR
2018-08-16 17:15:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216600  13 58346 62129789 A  ERRORERROR'
2018-08-16 17:15:29 [DEBUG   ] Got command RPT from MCS: ref #216601
2018-08-16 17:15:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:15:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216601  77 58346 62129993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:15:30 [DEBUG   ] Got command RPT from MCS: ref #216602
2018-08-16 17:15:30 [DEBUG   ] summary = ERROR
2018-08-16 17:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216602  13 58346 62130197 A  ERRORERROR'
2018-08-16 17:15:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 17:15:30 [DEBUG   ] Got command RPT from MCS: ref #216603
2018-08-16 17:15:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216603  77 58346 62130401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:15:30 [DEBUG   ] Got command RPT from MCS: ref #216604
2018-08-16 17:15:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216604  12 58346 62130593 A  ERRORBš™š'
2018-08-16 17:15:44 [DEBUG   ] Got command RPT from MCS: ref #216610
2018-08-16 17:15:44 [DEBUG   ] summary = ERROR
2018-08-16 17:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216610  13 58346 62144657 A  ERRORERROR'
2018-08-16 17:15:44 [DEBUG   ] Got command RPT from MCS: ref #216611
2018-08-16 17:15:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216611  77 58346 62144658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:15:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 17:16:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 17:16:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 17:16:09 [DEBUG   ] Finished updating board flags in 1.965 seconds
2018-08-16 17:16:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 17:16:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 17:16:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 17:17:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 17:17:09 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-08-16 17:17:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 17:17:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 17:17:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 17:18:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 17:18:09 [DEBUG   ] Finished updating board flags in 1.831 seconds
2018-08-16 17:18:10 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-16 17:18:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 17:18:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 17:19:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 17:19:09 [DEBUG   ] Finished updating board flags in 1.762 seconds
2018-08-16 17:19:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 17:19:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 17:19:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 17:20:09 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-08-16 17:20:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 17:20:29 [DEBUG   ] Got command RPT from MCS: ref #216635
2018-08-16 17:20:29 [DEBUG   ] summary = ERROR
2018-08-16 17:20:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216635  13 58346 62429886 A  ERRORERROR'
2018-08-16 17:20:30 [DEBUG   ] Got command RPT from MCS: ref #216636
2018-08-16 17:20:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216636  77 58346 62430081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:20:30 [DEBUG   ] Got command RPT from MCS: ref #216637
2018-08-16 17:20:30 [DEBUG   ] summary = ERROR
2018-08-16 17:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216637  13 58346 62430285 A  ERRORERROR'
2018-08-16 17:20:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 17:20:30 [DEBUG   ] Got command RPT from MCS: ref #216638
2018-08-16 17:20:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216638  77 58346 62430477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:20:30 [DEBUG   ] Got command RPT from MCS: ref #216639
2018-08-16 17:20:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:20:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216639  12 58346 62430685 A  ERRORBš™š'
2018-08-16 17:20:44 [DEBUG   ] Got command RPT from MCS: ref #216640
2018-08-16 17:20:44 [DEBUG   ] summary = ERROR
2018-08-16 17:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216640  13 58346 62444661 A  ERRORERROR'
2018-08-16 17:20:44 [DEBUG   ] Got command RPT from MCS: ref #216641
2018-08-16 17:20:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216641  77 58346 62444662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:20:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 17:21:09 [DEBUG   ] Finished updating board flags in 1.644 seconds
2018-08-16 17:21:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 17:21:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 17:21:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 17:22:09 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-08-16 17:22:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 17:22:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 17:22:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 17:23:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 17:23:09 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-08-16 17:23:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 17:23:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 17:23:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 17:24:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 17:24:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 17:24:09 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-08-16 17:24:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 17:24:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 17:24:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 17:25:10 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-08-16 17:25:10 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-08-16 17:25:29 [DEBUG   ] Got command RPT from MCS: ref #216667
2018-08-16 17:25:29 [DEBUG   ] summary = ERROR
2018-08-16 17:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216667  13 58346 62729985 A  ERRORERROR'
2018-08-16 17:25:30 [DEBUG   ] Got command RPT from MCS: ref #216668
2018-08-16 17:25:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216668  77 58346 62730185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:25:30 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-08-16 17:25:30 [DEBUG   ] Got command RPT from MCS: ref #216669
2018-08-16 17:25:30 [DEBUG   ] summary = ERROR
2018-08-16 17:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216669  13 58346 62730393 A  ERRORERROR'
2018-08-16 17:25:30 [DEBUG   ] Got command RPT from MCS: ref #216670
2018-08-16 17:25:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216670  77 58346 62730585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:25:30 [DEBUG   ] Got command RPT from MCS: ref #216671
2018-08-16 17:25:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:25:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216671  12 58346 62730789 A  ERRORBš™š'
2018-08-16 17:25:44 [DEBUG   ] Got command RPT from MCS: ref #216677
2018-08-16 17:25:44 [DEBUG   ] summary = ERROR
2018-08-16 17:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216677  13 58346 62744665 A  ERRORERROR'
2018-08-16 17:25:44 [DEBUG   ] Got command RPT from MCS: ref #216678
2018-08-16 17:25:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216678  77 58346 62744666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:25:51 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 17:26:10 [DEBUG   ] Finished updating board flags in 2.164 seconds
2018-08-16 17:26:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 17:26:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 17:26:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:27:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 17:27:10 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-08-16 17:27:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:27:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 17:27:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 17:28:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 17:28:10 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-08-16 17:28:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 17:28:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:28:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 17:29:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 17:29:11 [DEBUG   ] Finished updating board flags in 3.128 seconds
2018-08-16 17:29:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 17:29:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:30:10 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-08-16 17:30:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:30:30 [DEBUG   ] Got command RPT from MCS: ref #216698
2018-08-16 17:30:30 [DEBUG   ] summary = ERROR
2018-08-16 17:30:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216698  13 58346 63030093 A  ERRORERROR'
2018-08-16 17:30:30 [DEBUG   ] Got command RPT from MCS: ref #216699
2018-08-16 17:30:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:30:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216699  77 58346 63030297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:30:30 [DEBUG   ] Got command RPT from MCS: ref #216700
2018-08-16 17:30:30 [DEBUG   ] summary = ERROR
2018-08-16 17:30:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216700  13 58346 63030490 A  ERRORERROR'
2018-08-16 17:30:30 [DEBUG   ] Got command RPT from MCS: ref #216701
2018-08-16 17:30:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:30:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216701  77 58346 63030693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:30:31 [DEBUG   ] Got command RPT from MCS: ref #216702
2018-08-16 17:30:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:30:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216702  12 58346 63031101 A  ERRORB™™š'
2018-08-16 17:30:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 17:30:44 [DEBUG   ] Got command RPT from MCS: ref #216703
2018-08-16 17:30:44 [DEBUG   ] summary = ERROR
2018-08-16 17:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216703  13 58346 63044665 A  ERRORERROR'
2018-08-16 17:30:44 [DEBUG   ] Got command RPT from MCS: ref #216704
2018-08-16 17:30:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216704  77 58346 63044666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:30:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:31:10 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-08-16 17:31:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:31:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:31:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:32:10 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-16 17:32:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:32:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:32:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:33:10 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-16 17:33:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 17:33:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:33:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:34:10 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-08-16 17:34:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 17:34:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 17:34:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 17:35:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 17:35:10 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-08-16 17:35:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 17:35:30 [DEBUG   ] Got command RPT from MCS: ref #216730
2018-08-16 17:35:30 [DEBUG   ] summary = ERROR
2018-08-16 17:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216730  13 58346 63330193 A  ERRORERROR'
2018-08-16 17:35:30 [DEBUG   ] Got command RPT from MCS: ref #216731
2018-08-16 17:35:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216731  77 58346 63330397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:35:30 [DEBUG   ] Got command RPT from MCS: ref #216732
2018-08-16 17:35:30 [DEBUG   ] summary = ERROR
2018-08-16 17:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216732  13 58346 63330601 A  ERRORERROR'
2018-08-16 17:35:30 [DEBUG   ] Got command RPT from MCS: ref #216733
2018-08-16 17:35:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216733  77 58346 63330794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:35:30 [DEBUG   ] Got command RPT from MCS: ref #216734
2018-08-16 17:35:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216734  12 58346 63330997 A  ERRORB™™š'
2018-08-16 17:35:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 17:35:44 [DEBUG   ] Got command RPT from MCS: ref #216740
2018-08-16 17:35:44 [DEBUG   ] summary = ERROR
2018-08-16 17:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216740  13 58346 63344669 A  ERRORERROR'
2018-08-16 17:35:44 [DEBUG   ] Got command RPT from MCS: ref #216741
2018-08-16 17:35:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216741  77 58346 63344670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:35:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 17:36:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 17:36:11 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-08-16 17:36:11 [DEBUG   ] Finished updating board flags in 2.214 seconds
2018-08-16 17:36:31 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-16 17:36:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 17:37:11 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2018-08-16 17:37:11 [DEBUG   ] Finished updating board flags in 2.141 seconds
2018-08-16 17:37:31 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-08-16 17:37:51 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 17:38:11 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2018-08-16 17:38:11 [DEBUG   ] Finished updating board flags in 2.034 seconds
2018-08-16 17:38:32 [DEBUG   ] Finished updating ant stats in 1.358 seconds
2018-08-16 17:38:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:39:11 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-08-16 17:39:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:39:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 17:39:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 17:40:11 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-08-16 17:40:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:40:30 [DEBUG   ] Got command RPT from MCS: ref #216765
2018-08-16 17:40:30 [DEBUG   ] summary = ERROR
2018-08-16 17:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216765  13 58346 63630301 A  ERRORERROR'
2018-08-16 17:40:30 [DEBUG   ] Got command RPT from MCS: ref #216766
2018-08-16 17:40:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216766  77 58346 63630505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:40:30 [DEBUG   ] Got command RPT from MCS: ref #216767
2018-08-16 17:40:30 [DEBUG   ] summary = ERROR
2018-08-16 17:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216767  13 58346 63630709 A  ERRORERROR'
2018-08-16 17:40:30 [DEBUG   ] Got command RPT from MCS: ref #216768
2018-08-16 17:40:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:40:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216768  77 58346 63630914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:40:31 [DEBUG   ] Got command RPT from MCS: ref #216769
2018-08-16 17:40:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216769  12 58346 63631105 A  ERRORBœ™š'
2018-08-16 17:40:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 17:40:44 [DEBUG   ] Got command RPT from MCS: ref #216770
2018-08-16 17:40:44 [DEBUG   ] summary = ERROR
2018-08-16 17:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216770  13 58346 63644669 A  ERRORERROR'
2018-08-16 17:40:44 [DEBUG   ] Got command RPT from MCS: ref #216771
2018-08-16 17:40:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216771  77 58346 63644670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:40:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 17:41:11 [DEBUG   ] Finished updating board flags in 1.923 seconds
2018-08-16 17:41:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 17:41:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:41:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:42:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-08-16 17:42:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-08-16 17:42:11 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-08-16 17:42:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 17:42:32 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-08-16 17:42:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:43:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-08-16 17:43:11 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-08-16 17:43:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:43:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:43:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:44:11 [DEBUG   ] Finished updating board flags in 1.656 seconds
2018-08-16 17:44:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:44:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:44:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 17:45:11 [DEBUG   ] Finished updating board flags in 1.553 seconds
2018-08-16 17:45:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:45:30 [DEBUG   ] Got command RPT from MCS: ref #216793
2018-08-16 17:45:30 [DEBUG   ] summary = ERROR
2018-08-16 17:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216793  13 58346 63930417 A  ERRORERROR'
2018-08-16 17:45:30 [DEBUG   ] Got command RPT from MCS: ref #216794
2018-08-16 17:45:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216794  77 58346 63930621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:45:31 [DEBUG   ] Got command RPT from MCS: ref #216795
2018-08-16 17:45:31 [DEBUG   ] summary = ERROR
2018-08-16 17:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216795  13 58346 63931017 A  ERRORERROR'
2018-08-16 17:45:31 [DEBUG   ] Got command RPT from MCS: ref #216796
2018-08-16 17:45:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216796  77 58346 63931221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:45:31 [DEBUG   ] Got command RPT from MCS: ref #216798
2018-08-16 17:45:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216798  12 58346 63931418 A  ERRORBœ™š'
2018-08-16 17:45:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:45:44 [DEBUG   ] Got command RPT from MCS: ref #216803
2018-08-16 17:45:44 [DEBUG   ] summary = ERROR
2018-08-16 17:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216803  13 58346 63944673 A  ERRORERROR'
2018-08-16 17:45:44 [DEBUG   ] Got command RPT from MCS: ref #216804
2018-08-16 17:45:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216804  77 58346 63944674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:45:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 17:46:11 [DEBUG   ] Finished updating board flags in 1.543 seconds
2018-08-16 17:46:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 17:46:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:46:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:47:12 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-08-16 17:47:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:47:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:47:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:48:12 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-08-16 17:48:12 [DEBUG   ] Finished updating board flags in 2.153 seconds
2018-08-16 17:48:32 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2018-08-16 17:48:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 17:49:12 [DEBUG   ] Finished updating ant stats in 0.841 seconds
2018-08-16 17:49:12 [DEBUG   ] Finished updating board flags in 1.920 seconds
2018-08-16 17:49:32 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-16 17:49:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 17:50:12 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-08-16 17:50:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 17:50:12 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-08-16 17:50:30 [DEBUG   ] Got command RPT from MCS: ref #216828
2018-08-16 17:50:30 [DEBUG   ] summary = ERROR
2018-08-16 17:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216828  13 58346 64230505 A  ERRORERROR'
2018-08-16 17:50:30 [DEBUG   ] Got command RPT from MCS: ref #216829
2018-08-16 17:50:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216829  77 58346 64230709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:50:30 [DEBUG   ] Got command RPT from MCS: ref #216830
2018-08-16 17:50:30 [DEBUG   ] summary = ERROR
2018-08-16 17:50:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216830  13 58346 64230914 A  ERRORERROR'
2018-08-16 17:50:31 [DEBUG   ] Got command RPT from MCS: ref #216831
2018-08-16 17:50:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:50:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216831  77 58346 64231117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:50:31 [DEBUG   ] Got command RPT from MCS: ref #216832
2018-08-16 17:50:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:50:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216832  12 58346 64231309 A  ERRORBœ™š'
2018-08-16 17:50:32 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-08-16 17:50:44 [DEBUG   ] Got command RPT from MCS: ref #216833
2018-08-16 17:50:44 [DEBUG   ] summary = ERROR
2018-08-16 17:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216833  13 58346 64244665 A  ERRORERROR'
2018-08-16 17:50:44 [DEBUG   ] Got command RPT from MCS: ref #216834
2018-08-16 17:50:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:50:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216834  77 58346 64244666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:50:52 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 17:51:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 17:51:12 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-08-16 17:51:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-16 17:51:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 17:51:53 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-16 17:52:12 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-08-16 17:52:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:52:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 17:52:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 17:53:12 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-08-16 17:53:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:53:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:53:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 17:54:12 [DEBUG   ] Finished updating board flags in 1.735 seconds
2018-08-16 17:54:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 17:54:33 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 17:54:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 17:55:13 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 17:55:13 [DEBUG   ] Finished updating board flags in 2.316 seconds
2018-08-16 17:55:30 [DEBUG   ] Got command RPT from MCS: ref #216860
2018-08-16 17:55:30 [DEBUG   ] summary = ERROR
2018-08-16 17:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216860  13 58346 64530597 A  ERRORERROR'
2018-08-16 17:55:30 [DEBUG   ] Got command RPT from MCS: ref #216861
2018-08-16 17:55:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216861  77 58346 64530801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:55:30 [DEBUG   ] Got command RPT from MCS: ref #216862
2018-08-16 17:55:30 [DEBUG   ] summary = ERROR
2018-08-16 17:55:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216862  13 58346 64530993 A  ERRORERROR'
2018-08-16 17:55:31 [DEBUG   ] Got command RPT from MCS: ref #216863
2018-08-16 17:55:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216863  77 58346 64531197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:55:31 [DEBUG   ] Got command RPT from MCS: ref #216864
2018-08-16 17:55:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 17:55:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216864  12 58346 64531401 A  ERRORB›™š'
2018-08-16 17:55:33 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-16 17:55:44 [DEBUG   ] Got command RPT from MCS: ref #216870
2018-08-16 17:55:44 [DEBUG   ] summary = ERROR
2018-08-16 17:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216870  13 58346 64544669 A  ERRORERROR'
2018-08-16 17:55:44 [DEBUG   ] Got command RPT from MCS: ref #216871
2018-08-16 17:55:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 17:55:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216871  77 58346 64544670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 17:55:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 17:56:12 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-08-16 17:56:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-16 17:56:34 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 17:56:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 17:57:12 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 17:57:12 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-08-16 17:57:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 17:57:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 17:57:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 17:58:12 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-08-16 17:58:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 17:58:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 17:58:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 17:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 17:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 17:59:12 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-08-16 17:59:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 17:59:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 17:59:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 18:00:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 18:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 18:00:12 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-08-16 18:00:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:00:30 [DEBUG   ] Got command RPT from MCS: ref #216891
2018-08-16 18:00:30 [DEBUG   ] summary = ERROR
2018-08-16 18:00:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216891  13 58346 64830685 A  ERRORERROR'
2018-08-16 18:00:31 [DEBUG   ] Got command RPT from MCS: ref #216892
2018-08-16 18:00:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216892  77 58346 64831093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:00:31 [DEBUG   ] Got command RPT from MCS: ref #216893
2018-08-16 18:00:31 [DEBUG   ] summary = ERROR
2018-08-16 18:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216893  13 58346 64831285 A  ERRORERROR'
2018-08-16 18:00:31 [DEBUG   ] Got command RPT from MCS: ref #216894
2018-08-16 18:00:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216894  77 58346 64831489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:00:31 [DEBUG   ] Got command RPT from MCS: ref #216895
2018-08-16 18:00:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 18:00:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216895  12 58346 64831693 A  ERRORB›™š'
2018-08-16 18:00:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:00:44 [DEBUG   ] Got command RPT from MCS: ref #216896
2018-08-16 18:00:44 [DEBUG   ] summary = ERROR
2018-08-16 18:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216896  13 58346 64844665 A  ERRORERROR'
2018-08-16 18:00:44 [DEBUG   ] Got command RPT from MCS: ref #216897
2018-08-16 18:00:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:00:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216897  77 58346 64844666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:00:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:01:12 [DEBUG   ] Finished updating board flags in 1.511 seconds
2018-08-16 18:01:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:01:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:01:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 18:02:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 18:02:13 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-16 18:02:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:02:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 18:02:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-16 18:03:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 18:03:13 [DEBUG   ] Finished updating board flags in 2.318 seconds
2018-08-16 18:03:14 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-16 18:03:34 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 18:03:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-16 18:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 18:04:13 [DEBUG   ] Finished updating board flags in 2.108 seconds
2018-08-16 18:04:15 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-16 18:04:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 18:04:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 18:05:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 18:05:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 18:05:13 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-08-16 18:05:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 18:05:30 [DEBUG   ] Got command RPT from MCS: ref #216923
2018-08-16 18:05:30 [DEBUG   ] summary = ERROR
2018-08-16 18:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216923  13 58346 65130789 A  ERRORERROR'
2018-08-16 18:05:30 [DEBUG   ] Got command RPT from MCS: ref #216924
2018-08-16 18:05:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216924  77 58346 65130981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:05:31 [DEBUG   ] Got command RPT from MCS: ref #216925
2018-08-16 18:05:31 [DEBUG   ] summary = ERROR
2018-08-16 18:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216925  13 58346 65131185 A  ERRORERROR'
2018-08-16 18:05:31 [DEBUG   ] Got command RPT from MCS: ref #216926
2018-08-16 18:05:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216926  77 58346 65131389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:05:31 [DEBUG   ] Got command RPT from MCS: ref #216927
2018-08-16 18:05:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 18:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216927  12 58346 65131602 A  ERRORB›™š'
2018-08-16 18:05:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:05:44 [DEBUG   ] Got command RPT from MCS: ref #216933
2018-08-16 18:05:44 [DEBUG   ] summary = ERROR
2018-08-16 18:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216933  13 58346 65144669 A  ERRORERROR'
2018-08-16 18:05:44 [DEBUG   ] Got command RPT from MCS: ref #216934
2018-08-16 18:05:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:05:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216934  77 58346 65144670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:05:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 18:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 18:06:13 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-08-16 18:06:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 18:06:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 18:06:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 18:07:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-08-16 18:07:13 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-08-16 18:07:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 18:07:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 18:07:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 18:08:13 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-08-16 18:08:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 18:08:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 18:08:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 18:09:13 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-08-16 18:09:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 18:09:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 18:09:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 18:10:13 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-08-16 18:10:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 18:10:30 [DEBUG   ] Got command RPT from MCS: ref #216958
2018-08-16 18:10:30 [DEBUG   ] summary = ERROR
2018-08-16 18:10:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216958  13 58346 65430881 A  ERRORERROR'
2018-08-16 18:10:31 [DEBUG   ] Got command RPT from MCS: ref #216959
2018-08-16 18:10:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:10:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216959  77 58346 65431073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:10:31 [DEBUG   ] Got command RPT from MCS: ref #216960
2018-08-16 18:10:31 [DEBUG   ] summary = ERROR
2018-08-16 18:10:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216960  13 58346 65431277 A  ERRORERROR'
2018-08-16 18:10:31 [DEBUG   ] Got command RPT from MCS: ref #216961
2018-08-16 18:10:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:10:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216961  77 58346 65431481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:10:31 [DEBUG   ] Got command RPT from MCS: ref #216962
2018-08-16 18:10:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 18:10:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216962  12 58346 65431685 A  ERRORB›™š'
2018-08-16 18:10:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 18:10:44 [DEBUG   ] Got command RPT from MCS: ref #216963
2018-08-16 18:10:44 [DEBUG   ] summary = ERROR
2018-08-16 18:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216963  13 58346 65444669 A  ERRORERROR'
2018-08-16 18:10:44 [DEBUG   ] Got command RPT from MCS: ref #216964
2018-08-16 18:10:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216964  77 58346 65444670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:10:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 18:11:13 [DEBUG   ] Finished updating board flags in 1.670 seconds
2018-08-16 18:11:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-16 18:11:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 18:11:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:12:13 [DEBUG   ] Finished updating board flags in 1.685 seconds
2018-08-16 18:12:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:12:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:12:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 18:13:13 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-08-16 18:13:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:13:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:13:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:14:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 18:14:13 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-08-16 18:14:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 18:14:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:14:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:15:13 [DEBUG   ] Finished updating board flags in 1.494 seconds
2018-08-16 18:15:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:15:30 [DEBUG   ] Got command RPT from MCS: ref #216986
2018-08-16 18:15:30 [DEBUG   ] summary = ERROR
2018-08-16 18:15:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216986  13 58346 65730957 A  ERRORERROR'
2018-08-16 18:15:31 [DEBUG   ] Got command RPT from MCS: ref #216987
2018-08-16 18:15:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:15:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216987  77 58346 65731161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:15:31 [DEBUG   ] Got command RPT from MCS: ref #216988
2018-08-16 18:15:31 [DEBUG   ] summary = ERROR
2018-08-16 18:15:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216988  13 58346 65731365 A  ERRORERROR'
2018-08-16 18:15:31 [DEBUG   ] Got command RPT from MCS: ref #216989
2018-08-16 18:15:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:15:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216989  77 58346 65731557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:15:31 [DEBUG   ] Got command RPT from MCS: ref #216990
2018-08-16 18:15:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 18:15:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216990  12 58346 65731761 A  ERRORBš™š'
2018-08-16 18:15:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 18:15:44 [DEBUG   ] Got command RPT from MCS: ref #216996
2018-08-16 18:15:44 [DEBUG   ] summary = ERROR
2018-08-16 18:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216996  13 58346 65744669 A  ERRORERROR'
2018-08-16 18:15:44 [DEBUG   ] Got command RPT from MCS: ref #216997
2018-08-16 18:15:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:15:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   216997  77 58346 65744670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:15:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:16:14 [DEBUG   ] Finished updating board flags in 2.224 seconds
2018-08-16 18:16:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 18:16:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:16:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 18:17:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 18:17:14 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-08-16 18:17:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:17:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 18:17:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 18:18:14 [DEBUG   ] Finished updating board flags in 2.268 seconds
2018-08-16 18:18:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:18:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:18:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:19:14 [DEBUG   ] Finished updating board flags in 2.126 seconds
2018-08-16 18:19:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:19:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:19:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-08-16 18:20:14 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-08-16 18:20:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:20:31 [DEBUG   ] Got command RPT from MCS: ref #217021
2018-08-16 18:20:31 [DEBUG   ] summary = ERROR
2018-08-16 18:20:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217021  13 58346 66031057 A  ERRORERROR'
2018-08-16 18:20:31 [DEBUG   ] Got command RPT from MCS: ref #217022
2018-08-16 18:20:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:20:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217022  77 58346 66031261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:20:31 [DEBUG   ] Got command RPT from MCS: ref #217023
2018-08-16 18:20:31 [DEBUG   ] summary = ERROR
2018-08-16 18:20:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217023  13 58346 66031453 A  ERRORERROR'
2018-08-16 18:20:31 [DEBUG   ] Got command RPT from MCS: ref #217024
2018-08-16 18:20:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:20:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217024  77 58346 66031657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:20:31 [DEBUG   ] Got command RPT from MCS: ref #217025
2018-08-16 18:20:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 18:20:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217025  12 58346 66031861 A  ERRORBš™š'
2018-08-16 18:20:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:20:44 [DEBUG   ] Got command RPT from MCS: ref #217026
2018-08-16 18:20:44 [DEBUG   ] summary = ERROR
2018-08-16 18:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217026  13 58346 66044677 A  ERRORERROR'
2018-08-16 18:20:44 [DEBUG   ] Got command RPT from MCS: ref #217027
2018-08-16 18:20:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217027  77 58346 66044678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:20:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:21:14 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-08-16 18:21:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:21:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:21:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 18:22:14 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-08-16 18:22:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 18:22:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:22:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 18:23:14 [DEBUG   ] Finished updating board flags in 1.529 seconds
2018-08-16 18:23:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:23:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:23:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:24:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 18:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 18:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 18:24:14 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-08-16 18:24:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 18:24:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 18:24:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 18:25:15 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2018-08-16 18:25:15 [DEBUG   ] Finished updating board flags in 2.177 seconds
2018-08-16 18:25:31 [DEBUG   ] Got command RPT from MCS: ref #217053
2018-08-16 18:25:31 [DEBUG   ] summary = ERROR
2018-08-16 18:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217053  13 58346 66331133 A  ERRORERROR'
2018-08-16 18:25:31 [DEBUG   ] Got command RPT from MCS: ref #217054
2018-08-16 18:25:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217054  77 58346 66331337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:25:31 [DEBUG   ] Got command RPT from MCS: ref #217055
2018-08-16 18:25:31 [DEBUG   ] summary = ERROR
2018-08-16 18:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217055  13 58346 66331541 A  ERRORERROR'
2018-08-16 18:25:31 [DEBUG   ] Got command RPT from MCS: ref #217056
2018-08-16 18:25:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217056  77 58346 66331750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:25:31 [DEBUG   ] Got command RPT from MCS: ref #217057
2018-08-16 18:25:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 18:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217057  12 58346 66331941 A  ERRORBš™š'
2018-08-16 18:25:35 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-16 18:25:44 [DEBUG   ] Got command RPT from MCS: ref #217063
2018-08-16 18:25:44 [DEBUG   ] summary = ERROR
2018-08-16 18:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217063  13 58346 66344677 A  ERRORERROR'
2018-08-16 18:25:44 [DEBUG   ] Got command RPT from MCS: ref #217064
2018-08-16 18:25:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 18:25:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217064  77 58346 66344678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 18:25:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:26:15 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-08-16 18:26:15 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-08-16 18:26:35 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-08-16 18:26:55 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 18:27:00 [DEBUG   ] Got command INI from MCS: ref #217080
2018-08-16 18:27:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-16 18:27:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   217080   8 58346 66420066 ABOOTING'
2018-08-16 18:27:14 [DEBUG   ] Finished updating board flags in 0.794 seconds
2018-08-16 18:27:24 [INFO    ] -------------------
2018-08-16 18:27:24 [INFO    ]  LWA board status
2018-08-16 18:27:24 [INFO    ] -------------------
2018-08-16 18:27:24 [INFO    ] DP 1: 2 lwa27
2018-08-16 18:27:24 [INFO    ] DP 1: 3 lwa24
2018-08-16 18:27:24 [INFO    ] DP 1: 4 lwa23
2018-08-16 18:27:24 [INFO    ] DP 1: 5 lwa18
2018-08-16 18:27:24 [INFO    ] DP 1: 6 lwa10
2018-08-16 18:27:24 [INFO    ] DP 1: 7 lwa32
2018-08-16 18:27:24 [INFO    ] DP 1: 8 lwa11
2018-08-16 18:27:24 [INFO    ] DP 1: 9 lwa30
2018-08-16 18:27:24 [INFO    ] DP 1: 10 lwa12
2018-08-16 18:27:24 [INFO    ] DP 1: 11 lwa8
2018-08-16 18:27:24 [INFO    ] DP 1: 12 lwa13
2018-08-16 18:27:24 [INFO    ] DP 1: 13 lwa26
2018-08-16 18:27:24 [INFO    ] DP 1: 14 lwa14
2018-08-16 18:27:24 [INFO    ] DP 1: 16 lwa22
2018-08-16 18:27:24 [INFO    ] DP 1: 17 lwa20
2018-08-16 18:27:24 [INFO    ] DP 1: 18 lwa1
2018-08-16 18:27:24 [INFO    ] DP 1: 19 lwa5
2018-08-16 18:27:24 [INFO    ] DP 1: 20 lwa25
2018-08-16 18:27:24 [INFO    ] DP 1: 21 lwa35
2018-08-16 18:27:24 [INFO    ] DP 1: 22 lwa19
2018-08-16 18:27:24 [INFO    ] DP 1: 23 lwa21
2018-08-16 18:27:24 [INFO    ] DP 1: 24 lwa6
2018-08-16 18:27:24 [INFO    ] DP 1: 25 lwa7
2018-08-16 18:27:24 [INFO    ] DP 1: 26 lwa33
2018-08-16 18:27:24 [INFO    ] DP 1: 27 lwa15
2018-08-16 18:27:24 [INFO    ] DP 1: 28 lwa28
2018-08-16 18:27:24 [INFO    ] DP 2: 1 lwa16
2018-08-16 18:27:24 [INFO    ] DP 2: 15 lwa34
2018-08-16 18:27:24 [INFO    ] Total of 28 boards
2018-08-16 18:27:24 [INFO    ] Total of 260 stands
2018-08-16 18:27:24 [INFO    ] -------------------
2018-08-16 18:27:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29967
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29968
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29969
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29970
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29971
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29972
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29973
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29974
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29975
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29976
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29977
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29978
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29979
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29980
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29981
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29982
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29983
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29984
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29985
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29986
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29987
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29988
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29989
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29990
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29991
2018-08-16 18:27:32 [DEBUG   ] 2018-08-16 18:27:32 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29992
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29967 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29968 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29969 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29970 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29971 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29972 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29973 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29974 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29975 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29976 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29977 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29978 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29979 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29980 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29981 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29982 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29983 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29984 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29985 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29986 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29987 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29988 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29989 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29990 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29991 exited with status 0
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29992 exited with status 0
2018-08-16 18:27:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] spawn_process: at 2018-08-16 18:27:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30019
2018-08-16 18:27:44 [DEBUG   ] 2018-08-16 18:27:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30020
2018-08-16 18:27:50 [DEBUG   ] 2018-08-16 18:27:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30019 exited with status 0
2018-08-16 18:27:50 [DEBUG   ] 2018-08-16 18:27:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30020 exited with status 0
2018-08-16 18:27:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-16 18:27:50 [DEBUG   ] spawn_process: at 2018-08-16 18:27:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-16 18:27:50 [DEBUG   ] spawn_process: at 2018-08-16 18:27:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-16 18:27:50 [INFO    ] Setting Beam 1 xbars
2018-08-16 18:27:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-16 18:27:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-16 18:27:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-16 18:27:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-16 18:27:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-16 18:27:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-16 18:27:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-16 18:27:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-16 18:27:51 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-16 18:27:51 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-16 18:27:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-16 18:27:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-16 18:27:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-16 18:27:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-16 18:27:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-16 18:27:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-16 18:27:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-16 18:27:52 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-16 18:27:52 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-16 18:27:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-16 18:27:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-16 18:27:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-16 18:27:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-16 18:27:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-16 18:27:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-16 18:27:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-16 18:27:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-16 18:27:53 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-16 18:27:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-16 18:27:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-16 18:27:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-16 18:27:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-16 18:27:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-16 18:27:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-16 18:27:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-16 18:27:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-16 18:27:54 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-16 18:27:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-16 18:27:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-16 18:27:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-16 18:27:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-16 18:27:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-16 18:27:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-16 18:27:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-16 18:27:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-16 18:27:55 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-16 18:27:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-16 18:27:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-16 18:27:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-16 18:27:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-16 18:27:55 [INFO    ] Setting Beam 2 xbars
2018-08-16 18:27:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-16 18:27:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-16 18:27:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-16 18:27:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-16 18:27:56 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-16 18:27:56 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-16 18:27:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-16 18:27:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-16 18:27:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-16 18:27:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-16 18:27:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-16 18:27:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-16 18:27:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-16 18:27:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-16 18:27:57 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-16 18:27:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-16 18:27:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-16 18:27:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-16 18:27:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-16 18:27:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-16 18:27:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-16 18:27:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-16 18:27:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-16 18:27:58 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-16 18:27:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-16 18:27:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-16 18:27:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-16 18:27:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-16 18:27:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-16 18:27:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-16 18:27:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-16 18:27:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-16 18:27:59 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-16 18:27:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-16 18:27:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-16 18:27:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-16 18:27:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-16 18:27:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-16 18:27:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-16 18:27:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-16 18:27:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-16 18:28:00 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-16 18:28:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-16 18:28:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-16 18:28:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-16 18:28:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-16 18:28:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-16 18:28:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-16 18:28:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-16 18:28:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-16 18:28:00 [INFO    ] Setting Beam 3 xbars
2018-08-16 18:28:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-16 18:28:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-16 18:28:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-16 18:28:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-16 18:28:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-16 18:28:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-16 18:28:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-16 18:28:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-16 18:28:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-16 18:28:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-16 18:28:02 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-16 18:28:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-16 18:28:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-16 18:28:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-16 18:28:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-16 18:28:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-16 18:28:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-16 18:28:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-16 18:28:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-16 18:28:03 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-16 18:28:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-16 18:28:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-16 18:28:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-16 18:28:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-16 18:28:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-16 18:28:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-16 18:28:04 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-16 18:28:04 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-16 18:28:04 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-16 18:28:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-16 18:28:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-16 18:28:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-16 18:28:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-16 18:28:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-16 18:28:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-16 18:28:05 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-16 18:28:05 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-16 18:28:05 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-16 18:28:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-16 18:28:05 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-16 18:28:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-16 18:28:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-16 18:28:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-16 18:28:06 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-16 18:28:06 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-16 18:28:06 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-16 18:28:06 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-16 18:28:06 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-16 18:28:06 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-16 18:28:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-16 18:28:07 [INFO    ] Setting Beam 4 xbars
2018-08-16 18:28:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-16 18:28:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-16 18:28:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-16 18:28:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-16 18:28:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-16 18:28:07 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-16 18:28:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-16 18:28:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-16 18:28:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-16 18:28:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-16 18:28:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-16 18:28:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-16 18:28:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-16 18:28:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-16 18:28:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-16 18:28:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-16 18:28:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-16 18:28:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-16 18:28:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-16 18:28:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-16 18:28:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-16 18:28:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-16 18:28:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-16 18:28:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-16 18:28:09 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-16 18:28:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-16 18:28:09 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-16 18:28:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-16 18:28:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-16 18:28:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-16 18:28:10 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-16 18:28:10 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-16 18:28:10 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-16 18:28:10 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-16 18:28:10 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-16 18:28:10 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-16 18:28:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-16 18:28:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-16 18:28:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-16 18:28:11 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-16 18:28:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-16 18:28:11 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-16 18:28:11 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-16 18:28:11 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-16 18:28:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-16 18:28:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-16 18:28:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-16 18:28:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-16 18:28:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-16 18:28:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-16 18:28:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-16 18:28:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-16 18:28:12 [INFO    ] All xbars set
2018-08-16 18:28:12 [INFO    ] Setting adder chain routing for all beams
2018-08-16 18:28:17 [INFO    ] Setting beam ids
2018-08-16 18:28:27 [INFO    ] Starting beam delay calibration
2018-08-16 18:28:40 [INFO    ] Beam 1 latency is 6676
2018-08-16 18:28:40 [INFO    ] Beam 2 latency is 5732
2018-08-16 18:28:40 [INFO    ] Beam 3 latency is 5710
2018-08-16 18:28:40 [INFO    ] Beam 4 latency is 6676
2018-08-16 18:28:40 [INFO    ] Stop calibration
2018-08-16 18:28:48 [ERROR   ] Beam delay calibration failed
2018-08-16 18:28:48 [CRITICAL] Calibration failed
2018-08-16 18:28:48 [DEBUG   ] spawn_process: at 2018-08-16 18:28:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-16 18:28:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-16 18:28:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-16 18:28:48 [DEBUG   ] spawn_process: at 2018-08-16 18:28:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-16 18:28:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-16 18:28:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-16 18:28:48 [DEBUG   ] spawn_process: at 2018-08-16 18:28:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-16 18:28:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-16 18:28:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-16 18:28:48 [DEBUG   ] spawn_process: at 2018-08-16 18:28:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-16 18:28:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-16 18:28:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-16 18:28:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-16 18:28:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 265 ms (1534444129.266 s) with PID 31596 and time 1534444130
2018-08-16 18:28:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-16 18:28:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 355 ms (1534444129.357 s) with PID 31599 and time 1534444130
2018-08-16 18:28:50 [DEBUG   ] Finished updating ant stats in 0.890 seconds
2018-08-16 18:28:50 [INFO    ] Started antennas statistics background thread
2018-08-16 18:28:50 [INFO    ] Started board flags background thread
2018-08-16 18:28:50 [INFO    ] Started BAM background thread
2018-08-16 18:28:50 [INFO    ] Finished the INI process (ref. #217080) in 110.412 s
2018-08-16 18:28:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 18:28:51 [DEBUG   ] Finished updating board flags in 1.076 seconds
2018-08-16 18:29:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:29:30 [DEBUG   ] Got command RPT from MCS: ref #217085
2018-08-16 18:29:30 [DEBUG   ] summary = ERROR
2018-08-16 18:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217085  13 58346 66570065 A  ERRORERROR'
2018-08-16 18:29:30 [DEBUG   ] Got command RPT from MCS: ref #217086
2018-08-16 18:29:30 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed
2018-08-16 18:29:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217086  72 58346 66570066 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed'
2018-08-16 18:29:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:29:35 [DEBUG   ] Got command INI from MCS: ref #217087
2018-08-16 18:29:35 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-16 18:29:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   217087   8 58346 66575066 ABOOTING'
2018-08-16 18:29:55 [INFO    ] -------------------
2018-08-16 18:29:55 [INFO    ]  LWA board status
2018-08-16 18:29:55 [INFO    ] -------------------
2018-08-16 18:29:55 [INFO    ] DP 1: 2 lwa27
2018-08-16 18:29:55 [INFO    ] DP 1: 3 lwa24
2018-08-16 18:29:55 [INFO    ] DP 1: 4 lwa23
2018-08-16 18:29:55 [INFO    ] DP 1: 5 lwa18
2018-08-16 18:29:55 [INFO    ] DP 1: 6 lwa10
2018-08-16 18:29:55 [INFO    ] DP 1: 7 lwa32
2018-08-16 18:29:55 [INFO    ] DP 1: 8 lwa11
2018-08-16 18:29:55 [INFO    ] DP 1: 9 lwa30
2018-08-16 18:29:55 [INFO    ] DP 1: 10 lwa12
2018-08-16 18:29:55 [INFO    ] DP 1: 11 lwa8
2018-08-16 18:29:55 [INFO    ] DP 1: 12 lwa13
2018-08-16 18:29:55 [INFO    ] DP 1: 13 lwa26
2018-08-16 18:29:55 [INFO    ] DP 1: 14 lwa14
2018-08-16 18:29:55 [INFO    ] DP 1: 16 lwa22
2018-08-16 18:29:55 [INFO    ] DP 1: 17 lwa20
2018-08-16 18:29:55 [INFO    ] DP 1: 18 lwa1
2018-08-16 18:29:55 [INFO    ] DP 1: 19 lwa5
2018-08-16 18:29:55 [INFO    ] DP 1: 20 lwa25
2018-08-16 18:29:55 [INFO    ] DP 1: 21 lwa35
2018-08-16 18:29:55 [INFO    ] DP 1: 22 lwa19
2018-08-16 18:29:55 [INFO    ] DP 1: 23 lwa21
2018-08-16 18:29:55 [INFO    ] DP 1: 24 lwa6
2018-08-16 18:29:55 [INFO    ] DP 1: 25 lwa7
2018-08-16 18:29:55 [INFO    ] DP 1: 26 lwa33
2018-08-16 18:29:55 [INFO    ] DP 1: 27 lwa15
2018-08-16 18:29:55 [INFO    ] DP 1: 28 lwa28
2018-08-16 18:29:55 [INFO    ] DP 2: 1 lwa16
2018-08-16 18:29:55 [INFO    ] DP 2: 15 lwa34
2018-08-16 18:29:55 [INFO    ] Total of 28 boards
2018-08-16 18:29:55 [INFO    ] Total of 260 stands
2018-08-16 18:29:55 [INFO    ] -------------------
2018-08-16 18:29:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-16 18:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-16 18:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-16 18:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-16 18:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-16 18:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-16 18:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-16 18:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-16 18:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-16 18:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-16 18:30:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-16 18:30:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32078
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32079
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32080
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32081
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32082
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32083
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32084
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32085
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32086
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32087
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32088
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32089
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32090
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32091
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32092
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32093
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32094
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32095
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32096
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32097
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32098
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32099
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32100
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32101
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32102
2018-08-16 18:30:02 [DEBUG   ] 2018-08-16 18:30:02 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32103
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32078 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32079 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32080 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32081 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32082 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32083 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32084 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32085 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32086 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32087 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32088 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32089 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32090 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32091 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32092 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32093 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32094 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32095 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32096 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32097 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32098 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32099 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32100 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32101 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32102 exited with status 0
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32103 exited with status 0
2018-08-16 18:30:14 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] spawn_process: at 2018-08-16 18:30:14 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32137
2018-08-16 18:30:14 [DEBUG   ] 2018-08-16 18:30:14 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32138
2018-08-16 18:30:20 [DEBUG   ] 2018-08-16 18:30:20 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32137 exited with status 0
2018-08-16 18:30:20 [DEBUG   ] 2018-08-16 18:30:20 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32138 exited with status 0
2018-08-16 18:30:20 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-16 18:30:20 [DEBUG   ] spawn_process: at 2018-08-16 18:30:20 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-16 18:30:20 [DEBUG   ] spawn_process: at 2018-08-16 18:30:20 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-16 18:30:20 [INFO    ] Setting Beam 1 xbars
2018-08-16 18:30:20 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-16 18:30:20 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-16 18:30:20 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-16 18:30:20 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-16 18:30:20 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-16 18:30:21 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-16 18:30:21 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-16 18:30:21 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-16 18:30:21 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-16 18:30:21 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-16 18:30:21 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-16 18:30:21 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-16 18:30:21 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-16 18:30:21 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-16 18:30:22 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-16 18:30:22 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-16 18:30:22 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-16 18:30:22 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-16 18:30:22 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-16 18:30:22 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-16 18:30:22 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-16 18:30:22 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-16 18:30:22 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-16 18:30:22 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-16 18:30:23 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-16 18:30:23 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-16 18:30:23 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-16 18:30:23 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-16 18:30:23 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-16 18:30:23 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-16 18:30:23 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-16 18:30:23 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-16 18:30:23 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-16 18:30:24 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-16 18:30:24 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-16 18:30:24 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-16 18:30:24 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-16 18:30:24 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-16 18:30:24 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-16 18:30:24 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-16 18:30:24 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-16 18:30:24 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-16 18:30:25 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-16 18:30:25 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-16 18:30:25 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-16 18:30:25 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-16 18:30:25 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-16 18:30:25 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-16 18:30:25 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-16 18:30:25 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-16 18:30:25 [INFO    ] Setting Beam 2 xbars
2018-08-16 18:30:25 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-16 18:30:26 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-16 18:30:26 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-16 18:30:26 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-16 18:30:26 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-16 18:30:26 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-16 18:30:26 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-16 18:30:26 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-16 18:30:26 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-16 18:30:26 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-16 18:30:26 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-16 18:30:27 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-16 18:30:27 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-16 18:30:27 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-16 18:30:27 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-16 18:30:27 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-16 18:30:27 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-16 18:30:27 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-16 18:30:27 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-16 18:30:27 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-16 18:30:28 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-16 18:30:28 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-16 18:30:28 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-16 18:30:28 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-16 18:30:28 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-16 18:30:28 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-16 18:30:28 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-16 18:30:28 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-16 18:30:28 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-16 18:30:29 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-16 18:30:29 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-16 18:30:29 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-16 18:30:29 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-16 18:30:29 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-16 18:30:29 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-16 18:30:29 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-16 18:30:29 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-16 18:30:29 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-16 18:30:30 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-16 18:30:30 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-16 18:30:30 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-16 18:30:30 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-16 18:30:30 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-16 18:30:30 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-16 18:30:30 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-16 18:30:30 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-16 18:30:30 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-16 18:30:30 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-16 18:30:31 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-16 18:30:31 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-16 18:30:31 [DEBUG   ] Got command RPT from MCS: ref #217088
2018-08-16 18:30:31 [DEBUG   ] summary = BOOTING
2018-08-16 18:30:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217088  15 58346 66631221 ABOOTINGBOOTING'
2018-08-16 18:30:31 [INFO    ] Setting Beam 3 xbars
2018-08-16 18:30:31 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-16 18:30:31 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-16 18:30:31 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-16 18:30:31 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-16 18:30:31 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-16 18:30:31 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-16 18:30:31 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-16 18:30:32 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-16 18:30:32 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-16 18:30:32 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-16 18:30:32 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-16 18:30:32 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-16 18:30:32 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-16 18:30:32 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-16 18:30:32 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-16 18:30:32 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-16 18:30:33 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-16 18:30:33 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-16 18:30:33 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-16 18:30:33 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-16 18:30:33 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-16 18:30:33 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-16 18:30:33 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-16 18:30:33 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-16 18:30:33 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-16 18:30:34 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-16 18:30:34 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-16 18:30:34 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-16 18:30:34 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-16 18:30:34 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-16 18:30:34 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-16 18:30:34 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-16 18:30:34 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-16 18:30:34 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-16 18:30:34 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-16 18:30:35 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-16 18:30:35 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-16 18:30:35 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-16 18:30:35 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-16 18:30:35 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-16 18:30:35 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-16 18:30:35 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-16 18:30:35 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-16 18:30:35 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-16 18:30:36 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-16 18:30:36 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-16 18:30:36 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-16 18:30:36 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-16 18:30:36 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-16 18:30:36 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-16 18:30:36 [INFO    ] Setting Beam 4 xbars
2018-08-16 18:30:36 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-16 18:30:36 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-16 18:30:36 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-16 18:30:37 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-16 18:30:37 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-16 18:30:37 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-16 18:30:37 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-16 18:30:37 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-16 18:30:37 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-16 18:30:37 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-16 18:30:37 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-16 18:30:37 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-16 18:30:38 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-16 18:30:38 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-16 18:30:39 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-16 18:30:39 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-16 18:30:39 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-16 18:30:39 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-16 18:30:39 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-16 18:30:39 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-16 18:30:39 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-16 18:30:39 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-16 18:30:39 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-16 18:30:40 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-16 18:30:40 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-16 18:30:40 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-16 18:30:40 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-16 18:30:40 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-16 18:30:40 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-16 18:30:40 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-16 18:30:40 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-16 18:30:40 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-16 18:30:41 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-16 18:30:41 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-16 18:30:41 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-16 18:30:41 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-16 18:30:41 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-16 18:30:41 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-16 18:30:41 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-16 18:30:41 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-16 18:30:41 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-16 18:30:41 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-16 18:30:42 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-16 18:30:42 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-16 18:30:42 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-16 18:30:42 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-16 18:30:42 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-16 18:30:42 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-16 18:30:42 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-16 18:30:42 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-16 18:30:42 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-16 18:30:43 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-16 18:30:43 [INFO    ] All xbars set
2018-08-16 18:30:43 [INFO    ] Setting adder chain routing for all beams
2018-08-16 18:30:44 [DEBUG   ] Got command RPT from MCS: ref #217089
2018-08-16 18:30:44 [DEBUG   ] summary = BOOTING
2018-08-16 18:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217089  15 58346 66644673 ABOOTINGBOOTING'
2018-08-16 18:30:44 [DEBUG   ] Got command RPT from MCS: ref #217090
2018-08-16 18:30:44 [DEBUG   ] info = Starting calibration
2018-08-16 18:30:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217090  28 58346 66644674 ABOOTINGStarting calibration'
2018-08-16 18:30:47 [INFO    ] Setting beam ids
2018-08-16 18:30:58 [INFO    ] Starting beam delay calibration
2018-08-16 18:31:09 [INFO    ] Beam 1 latency is 6698
2018-08-16 18:31:09 [INFO    ] Beam 2 latency is 5742
2018-08-16 18:31:09 [INFO    ] Beam 3 latency is 5743
2018-08-16 18:31:09 [INFO    ] Beam 4 latency is 6688
2018-08-16 18:31:09 [INFO    ] Stop calibration
2018-08-16 18:31:17 [ERROR   ] Beam delay calibration failed
2018-08-16 18:31:17 [CRITICAL] Calibration failed
2018-08-16 18:31:17 [DEBUG   ] spawn_process: at 2018-08-16 18:31:17 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-16 18:31:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-16 18:31:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-16 18:31:17 [DEBUG   ] spawn_process: at 2018-08-16 18:31:17 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-16 18:31:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-16 18:31:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-16 18:31:18 [DEBUG   ] spawn_process: at 2018-08-16 18:31:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-16 18:31:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-16 18:31:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-16 18:31:18 [DEBUG   ] spawn_process: at 2018-08-16 18:31:18 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-16 18:31:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-16 18:31:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-16 18:31:18 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-16 18:31:19 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 275 ms (1534444279.276 s) with PID 1255 and time 1534444280
2018-08-16 18:31:19 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-16 18:31:19 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 371 ms (1534444279.373 s) with PID 1258 and time 1534444280
2018-08-16 18:31:20 [DEBUG   ] Finished updating ant stats in 0.874 seconds
2018-08-16 18:31:20 [INFO    ] Started antennas statistics background thread
2018-08-16 18:31:20 [INFO    ] Started board flags background thread
2018-08-16 18:31:20 [INFO    ] Started BAM background thread
2018-08-16 18:31:20 [INFO    ] Finished the INI process (ref. #217087) in 105.434 s
2018-08-16 18:31:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 18:31:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 18:31:21 [DEBUG   ] Finished updating board flags in 1.067 seconds
2018-08-16 18:31:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:32:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 18:32:05 [DEBUG   ] Got command RPT from MCS: ref #217110
2018-08-16 18:32:05 [DEBUG   ] summary = ERROR
2018-08-16 18:32:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217110  13 58346 66725065 A  ERRORERROR'
2018-08-16 18:32:05 [DEBUG   ] Got command RPT from MCS: ref #217111
2018-08-16 18:32:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed
2018-08-16 18:32:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217111  72 58346 66725066 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x06! Beamformer calibration failed'
2018-08-16 18:32:10 [DEBUG   ] Got command INI from MCS: ref #217112
2018-08-16 18:32:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-16 18:32:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   217112   8 58346 66730074 ABOOTING'
2018-08-16 18:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 18:32:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 18:32:21 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-08-16 18:32:30 [INFO    ] -------------------
2018-08-16 18:32:30 [INFO    ]  LWA board status
2018-08-16 18:32:30 [INFO    ] -------------------
2018-08-16 18:32:30 [INFO    ] DP 1: 2 lwa27
2018-08-16 18:32:30 [INFO    ] DP 1: 3 lwa24
2018-08-16 18:32:30 [INFO    ] DP 1: 4 lwa23
2018-08-16 18:32:30 [INFO    ] DP 1: 5 lwa18
2018-08-16 18:32:30 [INFO    ] DP 1: 6 lwa10
2018-08-16 18:32:30 [INFO    ] DP 1: 7 lwa32
2018-08-16 18:32:30 [INFO    ] DP 1: 8 lwa11
2018-08-16 18:32:30 [INFO    ] DP 1: 9 lwa30
2018-08-16 18:32:30 [INFO    ] DP 1: 10 lwa12
2018-08-16 18:32:30 [INFO    ] DP 1: 11 lwa8
2018-08-16 18:32:30 [INFO    ] DP 1: 12 lwa13
2018-08-16 18:32:30 [INFO    ] DP 1: 13 lwa26
2018-08-16 18:32:30 [INFO    ] DP 1: 14 lwa14
2018-08-16 18:32:30 [INFO    ] DP 1: 16 lwa22
2018-08-16 18:32:30 [INFO    ] DP 1: 17 lwa20
2018-08-16 18:32:30 [INFO    ] DP 1: 18 lwa1
2018-08-16 18:32:30 [INFO    ] DP 1: 19 lwa5
2018-08-16 18:32:30 [INFO    ] DP 1: 20 lwa25
2018-08-16 18:32:30 [INFO    ] DP 1: 21 lwa35
2018-08-16 18:32:30 [INFO    ] DP 1: 22 lwa19
2018-08-16 18:32:30 [INFO    ] DP 1: 23 lwa21
2018-08-16 18:32:30 [INFO    ] DP 1: 24 lwa6
2018-08-16 18:32:30 [INFO    ] DP 1: 25 lwa7
2018-08-16 18:32:30 [INFO    ] DP 1: 26 lwa33
2018-08-16 18:32:30 [INFO    ] DP 1: 27 lwa15
2018-08-16 18:32:30 [INFO    ] DP 1: 28 lwa28
2018-08-16 18:32:30 [INFO    ] DP 2: 1 lwa16
2018-08-16 18:32:30 [INFO    ] DP 2: 15 lwa34
2018-08-16 18:32:30 [INFO    ] Total of 28 boards
2018-08-16 18:32:30 [INFO    ] Total of 260 stands
2018-08-16 18:32:30 [INFO    ] -------------------
2018-08-16 18:32:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1753
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1754
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1755
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1756
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1757
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1758
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1759
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1760
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1761
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1762
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1763
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1764
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1765
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1766
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1767
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1768
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1769
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1770
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1771
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1772
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1773
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1774
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1775
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1776
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1777
2018-08-16 18:32:37 [DEBUG   ] 2018-08-16 18:32:37 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1778
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1753 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1754 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1755 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1756 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1757 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1758 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1759 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1760 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1761 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1762 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1763 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1764 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1765 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1766 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1767 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1768 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1769 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1770 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1771 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1772 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1773 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1774 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1775 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1776 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1777 exited with status 0
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1778 exited with status 0
2018-08-16 18:32:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] spawn_process: at 2018-08-16 18:32:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1805
2018-08-16 18:32:49 [DEBUG   ] 2018-08-16 18:32:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1806
2018-08-16 18:32:55 [DEBUG   ] 2018-08-16 18:32:55 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1805 exited with status 0
2018-08-16 18:32:55 [DEBUG   ] 2018-08-16 18:32:55 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1806 exited with status 0
2018-08-16 18:32:55 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-16 18:32:55 [DEBUG   ] spawn_process: at 2018-08-16 18:32:55 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-16 18:32:55 [DEBUG   ] spawn_process: at 2018-08-16 18:32:55 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-16 18:32:55 [INFO    ] Setting Beam 1 xbars
2018-08-16 18:32:55 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-16 18:32:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-16 18:32:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-16 18:32:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-16 18:32:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-16 18:32:56 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-16 18:32:56 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-16 18:32:56 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-16 18:32:56 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-16 18:32:56 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-16 18:32:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-16 18:32:56 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-16 18:32:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-16 18:32:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-16 18:32:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-16 18:32:57 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-16 18:32:57 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-16 18:32:57 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-16 18:32:57 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-16 18:32:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-16 18:32:57 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-16 18:32:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-16 18:32:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-16 18:32:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-16 18:32:58 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-16 18:32:58 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-16 18:32:58 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-16 18:32:58 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-16 18:32:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-16 18:32:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-16 18:32:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-16 18:32:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-16 18:32:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-16 18:32:59 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-16 18:32:59 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-16 18:32:59 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-16 18:32:59 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-16 18:32:59 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-16 18:32:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-16 18:32:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-16 18:32:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-16 18:32:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-16 18:33:00 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-16 18:33:00 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-16 18:33:00 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-16 18:33:00 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-16 18:33:00 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-16 18:33:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-16 18:33:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-16 18:33:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-16 18:33:00 [INFO    ] Setting Beam 2 xbars
2018-08-16 18:33:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-16 18:33:01 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-16 18:33:01 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-16 18:33:01 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-16 18:33:01 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-16 18:33:01 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-16 18:33:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-16 18:33:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-16 18:33:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-16 18:33:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-16 18:33:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-16 18:33:02 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-16 18:33:02 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-16 18:33:02 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-16 18:33:02 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-16 18:33:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-16 18:33:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-16 18:33:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-16 18:33:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-16 18:33:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-16 18:33:03 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-16 18:33:03 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-16 18:33:03 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-16 18:33:03 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-16 18:33:03 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-16 18:33:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-16 18:33:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-16 18:33:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-16 18:33:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-16 18:33:04 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-16 18:33:04 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-16 18:33:04 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-16 18:33:04 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-16 18:33:04 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-16 18:33:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-16 18:33:04 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-16 18:33:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-16 18:33:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-16 18:33:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-16 18:33:05 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-16 18:33:05 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-16 18:33:05 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-16 18:33:05 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-16 18:33:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-16 18:33:05 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-16 18:33:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-16 18:33:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-16 18:33:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-16 18:33:06 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-16 18:33:06 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-16 18:33:06 [INFO    ] Setting Beam 3 xbars
2018-08-16 18:33:06 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-16 18:33:06 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-16 18:33:06 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-16 18:33:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-16 18:33:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-16 18:33:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-16 18:33:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-16 18:33:07 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-16 18:33:07 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-16 18:33:07 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-16 18:33:07 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-16 18:33:07 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-16 18:33:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-16 18:33:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-16 18:33:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-16 18:33:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-16 18:33:08 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-16 18:33:08 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-16 18:33:08 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-16 18:33:08 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-16 18:33:08 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-16 18:33:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-16 18:33:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-16 18:33:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-16 18:33:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-16 18:33:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-16 18:33:09 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-16 18:33:09 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-16 18:33:09 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-16 18:33:09 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-16 18:33:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-16 18:33:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-16 18:33:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-16 18:33:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-16 18:33:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-16 18:33:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-16 18:33:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-16 18:33:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-16 18:33:10 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-16 18:33:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-16 18:33:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-16 18:33:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-16 18:33:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-16 18:33:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-16 18:33:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-16 18:33:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-16 18:33:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-16 18:33:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-16 18:33:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-16 18:33:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-16 18:33:11 [INFO    ] Setting Beam 4 xbars
2018-08-16 18:33:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-16 18:33:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-16 18:33:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-16 18:33:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-16 18:33:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-16 18:33:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-16 18:33:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-16 18:33:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-16 18:33:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-16 18:33:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-16 18:33:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-16 18:33:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-16 18:33:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-16 18:33:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-16 18:33:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-16 18:33:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-16 18:33:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-16 18:33:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-16 18:33:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-16 18:33:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-16 18:33:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-16 18:33:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-16 18:33:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-16 18:33:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-16 18:33:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-16 18:33:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-16 18:33:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-16 18:33:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-16 18:33:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-16 18:33:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-16 18:33:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-16 18:33:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-16 18:33:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-16 18:33:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-16 18:33:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-16 18:33:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-16 18:33:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-16 18:33:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-16 18:33:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-16 18:33:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-16 18:33:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-16 18:33:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-16 18:33:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-16 18:33:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-16 18:33:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-16 18:33:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-16 18:33:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-16 18:33:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-16 18:33:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-16 18:33:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-16 18:33:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-16 18:33:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-16 18:33:17 [INFO    ] All xbars set
2018-08-16 18:33:17 [INFO    ] Setting adder chain routing for all beams
2018-08-16 18:33:22 [INFO    ] Setting beam ids
2018-08-16 18:33:32 [INFO    ] Starting beam delay calibration
2018-08-16 18:33:44 [INFO    ] Beam 1 latency is 5733
2018-08-16 18:33:44 [INFO    ] Beam 2 latency is 5743
2018-08-16 18:33:44 [INFO    ] Beam 3 latency is 5736
2018-08-16 18:33:44 [INFO    ] Beam 4 latency is 5726
2018-08-16 18:33:44 [INFO    ] Stop calibration
2018-08-16 18:33:52 [INFO    ] Beam delay calibration successful
2018-08-16 18:33:52 [INFO    ] Calibration passed
2018-08-16 18:33:52 [DEBUG   ] spawn_process: at 2018-08-16 18:33:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-16 18:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-16 18:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-16 18:33:52 [DEBUG   ] spawn_process: at 2018-08-16 18:33:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-16 18:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-16 18:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-16 18:33:52 [DEBUG   ] spawn_process: at 2018-08-16 18:33:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-16 18:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-16 18:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-16 18:33:52 [DEBUG   ] spawn_process: at 2018-08-16 18:33:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-16 18:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-16 18:33:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-16 18:33:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-08-16 18:33:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 471 ms (1534444432.473 s) with PID 3478 and time 1534444433
2018-08-16 18:33:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-08-16 18:33:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 561 ms (1534444432.562 s) with PID 3481 and time 1534444433
2018-08-16 18:33:53 [DEBUG   ] Finished updating ant stats in 0.684 seconds
2018-08-16 18:33:53 [INFO    ] Started antennas statistics background thread
2018-08-16 18:33:53 [INFO    ] Started board flags background thread
2018-08-16 18:33:53 [INFO    ] Started BAM background thread
2018-08-16 18:33:53 [INFO    ] Finished the INI process (ref. #217112) in 103.613 s
2018-08-16 18:33:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 18:33:54 [DEBUG   ] Finished updating board flags in 1.314 seconds
2018-08-16 18:34:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:34:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:34:40 [DEBUG   ] Got command RPT from MCS: ref #217117
2018-08-16 18:34:40 [DEBUG   ] summary = NORMAL
2018-08-16 18:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217117  14 58346 66880073 A NORMALNORMAL'
2018-08-16 18:34:40 [DEBUG   ] Got command RPT from MCS: ref #217118
2018-08-16 18:34:40 [DEBUG   ] info = System calibrated and operating normally
2018-08-16 18:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217118  48 58346 66880074 A NORMALSystem calibrated and operating normally'
2018-08-16 18:34:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:34:54 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-08-16 18:35:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:35:31 [DEBUG   ] Got command RPT from MCS: ref #217121
2018-08-16 18:35:31 [DEBUG   ] summary = NORMAL
2018-08-16 18:35:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217121  14 58346 66931329 A NORMALNORMAL'
2018-08-16 18:35:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:35:44 [DEBUG   ] Got command RPT from MCS: ref #217127
2018-08-16 18:35:44 [DEBUG   ] summary = NORMAL
2018-08-16 18:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217127  14 58346 66944677 A NORMALNORMAL'
2018-08-16 18:35:44 [DEBUG   ] Got command RPT from MCS: ref #217128
2018-08-16 18:35:44 [DEBUG   ] info = System calibrated and operating normally
2018-08-16 18:35:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217128  48 58346 66944678 A NORMALSystem calibrated and operating normally'
2018-08-16 18:35:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:35:55 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-08-16 18:36:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:36:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:36:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 18:36:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 18:36:55 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-08-16 18:37:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:37:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:37:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:37:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-08-16 18:37:55 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-08-16 18:38:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 18:38:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-16 18:38:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 18:38:55 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-08-16 18:39:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 18:39:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 18:39:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 18:39:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 18:39:55 [DEBUG   ] Finished updating board flags in 1.180 seconds
2018-08-16 18:40:13 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-08-16 18:40:31 [DEBUG   ] Got command RPT from MCS: ref #217152
2018-08-16 18:40:31 [DEBUG   ] summary = NORMAL
2018-08-16 18:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217152  14 58346 67231429 A NORMALNORMAL'
2018-08-16 18:40:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:40:44 [DEBUG   ] Got command RPT from MCS: ref #217153
2018-08-16 18:40:44 [DEBUG   ] summary = NORMAL
2018-08-16 18:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217153  14 58346 67244685 A NORMALNORMAL'
2018-08-16 18:40:44 [DEBUG   ] Got command RPT from MCS: ref #217154
2018-08-16 18:40:44 [DEBUG   ] info = System calibrated and operating normally
2018-08-16 18:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217154  48 58346 67244686 A NORMALSystem calibrated and operating normally'
2018-08-16 18:40:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:40:55 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-08-16 18:41:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:41:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:41:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:41:55 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-08-16 18:42:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:42:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:42:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:42:56 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-08-16 18:43:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:43:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:43:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:43:55 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-08-16 18:44:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:44:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:44:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:44:55 [DEBUG   ] Finished updating board flags in 1.237 seconds
2018-08-16 18:45:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 18:45:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 18:45:37 [DEBUG   ] Got command SHT from MCS: ref #217175
2018-08-16 18:45:37 [DEBUG   ] Stopping antenna statistics
2018-08-16 18:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_SHT   217175   8 58346 67537613 ASHUTDWN'
2018-08-16 18:45:38 [DEBUG   ] Stopping beam statistics
2018-08-16 18:45:38 [DEBUG   ] Stopping monitoring flags
2018-08-16 18:45:38 [DEBUG   ] Stopping BAM updater
2018-08-16 18:45:39 [DEBUG   ] Stopping DRX time setter
2018-08-16 18:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:44 [DEBUG   ] Got command RPT from MCS: ref #217176
2018-08-16 18:45:44 [DEBUG   ] summary = SHUTDWN
2018-08-16 18:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217176  15 58346 67544689 ASHUTDWNSHUTDWN'
2018-08-16 18:45:44 [DEBUG   ] Got command RPT from MCS: ref #217177
2018-08-16 18:45:44 [DEBUG   ] info = System is shutting down
2018-08-16 18:45:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   217177  31 58346 67544690 ASHUTDWNSystem is shutting down'
2018-08-16 18:45:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-08-16 18:45:49 [DEBUG   ] run_process: at 2018-08-16 18:45:49 running ['/usr/local/bin/lwa16', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:49 [DEBUG   ] run_process: at 2018-08-16 18:45:49 running ['/usr/local/bin/lwa27', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:49 [DEBUG   ] run_process: at 2018-08-16 18:45:49 running ['/usr/local/bin/lwa24', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:49 [DEBUG   ] run_process: at 2018-08-16 18:45:49 running ['/usr/local/bin/lwa23', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:50 [DEBUG   ] run_process: at 2018-08-16 18:45:50 running ['/usr/local/bin/lwa18', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:50 [DEBUG   ] run_process: at 2018-08-16 18:45:50 running ['/usr/local/bin/lwa10', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:50 [DEBUG   ] run_process: at 2018-08-16 18:45:50 running ['/usr/local/bin/lwa32', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:50 [DEBUG   ] run_process: at 2018-08-16 18:45:50 running ['/usr/local/bin/lwa11', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:50 [DEBUG   ] run_process: at 2018-08-16 18:45:50 running ['/usr/local/bin/lwa30', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:50 [DEBUG   ] run_process: at 2018-08-16 18:45:50 running ['/usr/local/bin/lwa12', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:50 [DEBUG   ] run_process: at 2018-08-16 18:45:50 running ['/usr/local/bin/lwa8', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:50 [DEBUG   ] run_process: at 2018-08-16 18:45:50 running ['/usr/local/bin/lwa13', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:50 [DEBUG   ] run_process: at 2018-08-16 18:45:50 running ['/usr/local/bin/lwa26', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:51 [DEBUG   ] run_process: at 2018-08-16 18:45:51 running ['/usr/local/bin/lwa14', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:51 [DEBUG   ] run_process: at 2018-08-16 18:45:51 running ['/usr/local/bin/lwa34', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:51 [DEBUG   ] run_process: at 2018-08-16 18:45:51 running ['/usr/local/bin/lwa22', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:51 [DEBUG   ] run_process: at 2018-08-16 18:45:51 running ['/usr/local/bin/lwa20', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:51 [DEBUG   ] run_process: at 2018-08-16 18:45:51 running ['/usr/local/bin/lwa1', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:51 [DEBUG   ] run_process: at 2018-08-16 18:45:51 running ['/usr/local/bin/lwa5', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:51 [DEBUG   ] run_process: at 2018-08-16 18:45:51 running ['/usr/local/bin/lwa25', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:51 [DEBUG   ] run_process: at 2018-08-16 18:45:51 running ['/usr/local/bin/lwa35', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:51 [DEBUG   ] run_process: at 2018-08-16 18:45:51 running ['/usr/local/bin/lwa19', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:52 [DEBUG   ] run_process: at 2018-08-16 18:45:52 running ['/usr/local/bin/lwa21', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:52 [DEBUG   ] run_process: at 2018-08-16 18:45:52 running ['/usr/local/bin/lwa6', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:52 [DEBUG   ] run_process: at 2018-08-16 18:45:52 running ['/usr/local/bin/lwa7', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:52 [DEBUG   ] run_process: at 2018-08-16 18:45:52 running ['/usr/local/bin/lwa33', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:52 [DEBUG   ] run_process: at 2018-08-16 18:45:52 running ['/usr/local/bin/lwa15', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:52 [DEBUG   ] run_process: at 2018-08-16 18:45:52 running ['/usr/local/bin/lwa28', '/lwa/software/Shutdown.sh']
2018-08-16 18:45:52 [INFO    ] Finished the SHT process in 15.172 s
2018-08-16 20:27:11 [DEBUG   ] Got command RPT from MCS: ref #57
2018-08-16 20:27:11 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       57  15 58346 73631017 ASHUTDWNSHUTDWN'
2018-08-16 20:27:11 [DEBUG   ] Got command RPT from MCS: ref #58
2018-08-16 20:27:11 [DEBUG   ] info = System has been shut down
2018-08-16 20:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       58  33 58346 73631018 ASHUTDWNSystem has been shut down'
2018-08-16 20:30:03 [DEBUG   ] Got command RPT from MCS: ref #2
2018-08-16 20:30:03 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT        2  15 58346 73803457 ASHUTDWNSHUTDWN'
2018-08-16 20:30:03 [DEBUG   ] Got command RPT from MCS: ref #3
2018-08-16 20:30:03 [DEBUG   ] info = System has been shut down
2018-08-16 20:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT        3  33 58346 73803458 ASHUTDWNSystem has been shut down'
2018-08-16 20:32:23 [DEBUG   ] Got command RPT from MCS: ref #21
2018-08-16 20:32:23 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       21  15 58346 73943857 ASHUTDWNSHUTDWN'
2018-08-16 20:32:26 [DEBUG   ] Got command RPT from MCS: ref #29
2018-08-16 20:32:26 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       29  15 58346 73946869 ASHUTDWNSHUTDWN'
2018-08-16 20:35:03 [DEBUG   ] Got command RPT from MCS: ref #37
2018-08-16 20:35:03 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       37  15 58346 74103469 ASHUTDWNSHUTDWN'
2018-08-16 20:35:03 [DEBUG   ] Got command RPT from MCS: ref #38
2018-08-16 20:35:03 [DEBUG   ] info = System has been shut down
2018-08-16 20:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       38  33 58346 74103470 ASHUTDWNSystem has been shut down'
2018-08-16 20:37:26 [DEBUG   ] Got command RPT from MCS: ref #57
2018-08-16 20:37:26 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:37:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       57  15 58346 74246945 ASHUTDWNSHUTDWN'
2018-08-16 20:40:03 [DEBUG   ] Got command RPT from MCS: ref #61
2018-08-16 20:40:03 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       61  15 58346 74403465 ASHUTDWNSHUTDWN'
2018-08-16 20:40:03 [DEBUG   ] Got command RPT from MCS: ref #62
2018-08-16 20:40:03 [DEBUG   ] info = System has been shut down
2018-08-16 20:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       62  33 58346 74403466 ASHUTDWNSystem has been shut down'
2018-08-16 20:42:27 [DEBUG   ] Got command RPT from MCS: ref #83
2018-08-16 20:42:27 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       83  15 58346 74547021 ASHUTDWNSHUTDWN'
2018-08-16 20:45:03 [DEBUG   ] Got command RPT from MCS: ref #94
2018-08-16 20:45:03 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       94  15 58346 74703469 ASHUTDWNSHUTDWN'
2018-08-16 20:45:03 [DEBUG   ] Got command RPT from MCS: ref #95
2018-08-16 20:45:03 [DEBUG   ] info = System has been shut down
2018-08-16 20:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT       95  33 58346 74703470 ASHUTDWNSystem has been shut down'
2018-08-16 20:45:16 [DEBUG   ] Got command RPT from MCS: ref #111
2018-08-16 20:45:16 [DEBUG   ] info = System has been shut down
2018-08-16 20:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      111  33 58346 74716117 ASHUTDWNSystem has been shut down'
2018-08-16 20:47:27 [DEBUG   ] Got command RPT from MCS: ref #114
2018-08-16 20:47:27 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:47:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      114  15 58346 74847097 ASHUTDWNSHUTDWN'
2018-08-16 20:50:03 [DEBUG   ] Got command RPT from MCS: ref #116
2018-08-16 20:50:03 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      116  15 58346 75003469 ASHUTDWNSHUTDWN'
2018-08-16 20:50:03 [DEBUG   ] Got command RPT from MCS: ref #117
2018-08-16 20:50:03 [DEBUG   ] info = System has been shut down
2018-08-16 20:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      117  33 58346 75003470 ASHUTDWNSystem has been shut down'
2018-08-16 20:52:27 [DEBUG   ] Got command RPT from MCS: ref #138
2018-08-16 20:52:27 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:52:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      138  15 58346 75147181 ASHUTDWNSHUTDWN'
2018-08-16 20:55:03 [DEBUG   ] Got command RPT from MCS: ref #152
2018-08-16 20:55:03 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      152  15 58346 75303477 ASHUTDWNSHUTDWN'
2018-08-16 20:55:03 [DEBUG   ] Got command RPT from MCS: ref #153
2018-08-16 20:55:03 [DEBUG   ] info = System has been shut down
2018-08-16 20:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      153  33 58346 75303478 ASHUTDWNSystem has been shut down'
2018-08-16 20:57:23 [DEBUG   ] Got command RPT from MCS: ref #176
2018-08-16 20:57:23 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      176  15 58346 75443637 ASHUTDWNSHUTDWN'
2018-08-16 20:57:23 [DEBUG   ] Got command RPT from MCS: ref #177
2018-08-16 20:57:23 [DEBUG   ] info = System has been shut down
2018-08-16 20:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      177  33 58346 75443841 ASHUTDWNSystem has been shut down'
2018-08-16 20:57:27 [DEBUG   ] Got command RPT from MCS: ref #183
2018-08-16 20:57:27 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      183  15 58346 75447249 ASHUTDWNSHUTDWN'
2018-08-16 20:57:29 [DEBUG   ] Got command RPT from MCS: ref #187
2018-08-16 20:57:29 [DEBUG   ] summary = SHUTDWN
2018-08-16 20:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      187  15 58346 75449577 ASHUTDWNSHUTDWN'
2018-08-16 20:57:29 [DEBUG   ] Got command RPT from MCS: ref #188
2018-08-16 20:57:29 [DEBUG   ] info = System has been shut down
2018-08-16 20:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      188  33 58346 75449781 ASHUTDWNSystem has been shut down'
2018-08-16 21:00:03 [DEBUG   ] Got command RPT from MCS: ref #204
2018-08-16 21:00:03 [DEBUG   ] summary = SHUTDWN
2018-08-16 21:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      204  15 58346 75603465 ASHUTDWNSHUTDWN'
2018-08-16 21:00:03 [DEBUG   ] Got command RPT from MCS: ref #205
2018-08-16 21:00:03 [DEBUG   ] info = System has been shut down
2018-08-16 21:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      205  33 58346 75603466 ASHUTDWNSystem has been shut down'
2018-08-16 21:02:27 [DEBUG   ] Got command RPT from MCS: ref #227
2018-08-16 21:02:27 [DEBUG   ] summary = SHUTDWN
2018-08-16 21:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      227  15 58346 75747329 ASHUTDWNSHUTDWN'
2018-08-16 21:05:03 [DEBUG   ] Got command RPT from MCS: ref #233
2018-08-16 21:05:03 [DEBUG   ] summary = SHUTDWN
2018-08-16 21:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      233  15 58346 75903473 ASHUTDWNSHUTDWN'
2018-08-16 21:05:03 [DEBUG   ] Got command RPT from MCS: ref #234
2018-08-16 21:05:03 [DEBUG   ] info = System has been shut down
2018-08-16 21:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      234  33 58346 75903474 ASHUTDWNSystem has been shut down'
2018-08-16 21:06:23 [DEBUG   ] Got command INI from MCS: ref #254
2018-08-16 21:06:23 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-08-16 21:06:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI      254   8 58346 75983721 ABOOTING'
2018-08-16 21:06:43 [INFO    ] -------------------
2018-08-16 21:06:43 [INFO    ]  LWA board status
2018-08-16 21:06:43 [INFO    ] -------------------
2018-08-16 21:06:43 [INFO    ] DP 1: 2 lwa27
2018-08-16 21:06:43 [INFO    ] DP 1: 3 lwa24
2018-08-16 21:06:43 [INFO    ] DP 1: 4 lwa23
2018-08-16 21:06:43 [INFO    ] DP 1: 5 lwa18
2018-08-16 21:06:43 [INFO    ] DP 1: 6 lwa10
2018-08-16 21:06:43 [INFO    ] DP 1: 7 lwa32
2018-08-16 21:06:43 [INFO    ] DP 1: 8 lwa11
2018-08-16 21:06:43 [INFO    ] DP 1: 9 lwa30
2018-08-16 21:06:43 [INFO    ] DP 1: 10 lwa12
2018-08-16 21:06:43 [INFO    ] DP 1: 11 lwa8
2018-08-16 21:06:43 [INFO    ] DP 1: 12 lwa13
2018-08-16 21:06:43 [INFO    ] DP 1: 13 lwa26
2018-08-16 21:06:43 [INFO    ] DP 1: 14 lwa14
2018-08-16 21:06:43 [INFO    ] DP 1: 16 lwa22
2018-08-16 21:06:43 [INFO    ] DP 1: 17 lwa20
2018-08-16 21:06:43 [INFO    ] DP 1: 18 lwa1
2018-08-16 21:06:43 [INFO    ] DP 1: 19 lwa5
2018-08-16 21:06:43 [INFO    ] DP 1: 20 lwa25
2018-08-16 21:06:43 [INFO    ] DP 1: 21 lwa35
2018-08-16 21:06:43 [INFO    ] DP 1: 22 lwa19
2018-08-16 21:06:43 [INFO    ] DP 1: 23 lwa21
2018-08-16 21:06:43 [INFO    ] DP 1: 24 lwa6
2018-08-16 21:06:43 [INFO    ] DP 1: 25 lwa7
2018-08-16 21:06:43 [INFO    ] DP 1: 26 lwa33
2018-08-16 21:06:43 [INFO    ] DP 1: 27 lwa15
2018-08-16 21:06:43 [INFO    ] DP 1: 28 lwa28
2018-08-16 21:06:43 [INFO    ] DP 2: 1 lwa16
2018-08-16 21:06:43 [INFO    ] DP 2: 15 lwa34
2018-08-16 21:06:43 [INFO    ] Total of 28 boards
2018-08-16 21:06:43 [INFO    ] Total of 260 stands
2018-08-16 21:06:43 [INFO    ] -------------------
2018-08-16 21:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5916
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5917
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5918
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5919
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5920
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5921
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5922
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5923
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5924
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5925
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5926
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5927
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5928
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5929
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5930
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5931
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5932
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5933
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5934
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5935
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5936
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5937
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5938
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5939
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5940
2018-08-16 21:06:50 [DEBUG   ] 2018-08-16 21:06:50 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5941
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5916 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5917 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5918 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5919 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5920 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5921 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5922 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5923 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5924 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5925 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5926 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5927 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5928 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5929 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5930 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5931 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5932 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5933 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5934 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5935 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5936 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5937 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5938 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5939 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5940 exited with status 0
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5941 exited with status 0
2018-08-16 21:07:02 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] spawn_process: at 2018-08-16 21:07:02 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5968
2018-08-16 21:07:02 [DEBUG   ] 2018-08-16 21:07:02 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5969
2018-08-16 21:07:07 [DEBUG   ] 2018-08-16 21:07:07 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5968 exited with status 0
2018-08-16 21:07:07 [DEBUG   ] 2018-08-16 21:07:07 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5969 exited with status 0
2018-08-16 21:07:07 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-08-16 21:07:07 [DEBUG   ] spawn_process: at 2018-08-16 21:07:07 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-08-16 21:07:07 [DEBUG   ] spawn_process: at 2018-08-16 21:07:07 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-08-16 21:07:07 [INFO    ] Setting Beam 1 xbars
2018-08-16 21:07:07 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-08-16 21:07:08 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-08-16 21:07:08 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-08-16 21:07:08 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-08-16 21:07:08 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-08-16 21:07:08 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-08-16 21:07:08 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-08-16 21:07:08 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-08-16 21:07:08 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-08-16 21:07:08 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-08-16 21:07:09 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-08-16 21:07:09 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-08-16 21:07:09 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-08-16 21:07:09 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-08-16 21:07:09 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-08-16 21:07:09 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-08-16 21:07:09 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-08-16 21:07:09 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-08-16 21:07:09 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-08-16 21:07:10 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-08-16 21:07:10 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-08-16 21:07:10 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-08-16 21:07:10 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-08-16 21:07:10 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-08-16 21:07:10 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-08-16 21:07:10 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-08-16 21:07:10 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-08-16 21:07:10 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-08-16 21:07:10 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-08-16 21:07:11 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-08-16 21:07:11 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-08-16 21:07:11 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-08-16 21:07:11 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-08-16 21:07:11 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-08-16 21:07:11 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-08-16 21:07:11 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-08-16 21:07:11 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-08-16 21:07:11 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-08-16 21:07:12 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-08-16 21:07:12 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-08-16 21:07:12 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-08-16 21:07:12 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-08-16 21:07:12 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-08-16 21:07:12 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-08-16 21:07:12 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-08-16 21:07:12 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-08-16 21:07:12 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-08-16 21:07:13 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-08-16 21:07:13 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-08-16 21:07:13 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-08-16 21:07:13 [INFO    ] Setting Beam 2 xbars
2018-08-16 21:07:13 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-08-16 21:07:13 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-08-16 21:07:13 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-08-16 21:07:13 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-08-16 21:07:13 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-08-16 21:07:13 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-08-16 21:07:14 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-08-16 21:07:14 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-08-16 21:07:14 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-08-16 21:07:14 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-08-16 21:07:14 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-08-16 21:07:14 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-08-16 21:07:14 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-08-16 21:07:14 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-08-16 21:07:14 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-08-16 21:07:14 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-08-16 21:07:15 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-08-16 21:07:15 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-08-16 21:07:15 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-08-16 21:07:15 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-08-16 21:07:15 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-08-16 21:07:15 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-08-16 21:07:15 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-08-16 21:07:15 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-08-16 21:07:15 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-08-16 21:07:16 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-08-16 21:07:16 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-08-16 21:07:16 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-08-16 21:07:16 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-08-16 21:07:16 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-08-16 21:07:16 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-08-16 21:07:16 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-08-16 21:07:16 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-08-16 21:07:16 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-08-16 21:07:17 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-08-16 21:07:17 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-08-16 21:07:17 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-08-16 21:07:17 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-08-16 21:07:17 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-08-16 21:07:17 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-08-16 21:07:17 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-08-16 21:07:17 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-08-16 21:07:17 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-08-16 21:07:17 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-08-16 21:07:18 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-08-16 21:07:18 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-08-16 21:07:18 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-08-16 21:07:18 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-08-16 21:07:18 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-08-16 21:07:18 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-08-16 21:07:18 [INFO    ] Setting Beam 3 xbars
2018-08-16 21:07:18 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-08-16 21:07:18 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-08-16 21:07:18 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-08-16 21:07:19 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-08-16 21:07:19 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-08-16 21:07:19 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-08-16 21:07:19 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-08-16 21:07:19 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-08-16 21:07:19 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-08-16 21:07:19 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-08-16 21:07:19 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-08-16 21:07:19 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-08-16 21:07:20 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-08-16 21:07:20 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-08-16 21:07:20 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-08-16 21:07:20 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-08-16 21:07:20 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-08-16 21:07:20 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-08-16 21:07:20 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-08-16 21:07:20 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-08-16 21:07:20 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-08-16 21:07:21 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-08-16 21:07:21 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-08-16 21:07:21 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-08-16 21:07:21 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-08-16 21:07:21 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-08-16 21:07:21 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-08-16 21:07:21 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-08-16 21:07:21 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-08-16 21:07:21 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-08-16 21:07:21 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-08-16 21:07:22 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-08-16 21:07:22 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-08-16 21:07:22 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-08-16 21:07:22 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-08-16 21:07:22 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-08-16 21:07:22 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-08-16 21:07:22 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-08-16 21:07:22 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-08-16 21:07:22 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-08-16 21:07:23 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-08-16 21:07:23 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-08-16 21:07:23 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-08-16 21:07:23 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-08-16 21:07:23 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-08-16 21:07:23 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-08-16 21:07:23 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-08-16 21:07:23 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-08-16 21:07:23 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-08-16 21:07:24 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-08-16 21:07:24 [INFO    ] Setting Beam 4 xbars
2018-08-16 21:07:24 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-08-16 21:07:24 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-16 21:07:24 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-16 21:07:24 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-08-16 21:07:24 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-08-16 21:07:24 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-08-16 21:07:24 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-08-16 21:07:24 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-08-16 21:07:24 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-08-16 21:07:25 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-08-16 21:07:25 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-08-16 21:07:25 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-08-16 21:07:25 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-08-16 21:07:25 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-08-16 21:07:25 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-08-16 21:07:25 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-08-16 21:07:25 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-08-16 21:07:25 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-08-16 21:07:26 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-08-16 21:07:26 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-08-16 21:07:26 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-08-16 21:07:26 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-08-16 21:07:26 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-08-16 21:07:26 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-08-16 21:07:26 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-08-16 21:07:26 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-08-16 21:07:26 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-08-16 21:07:27 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-08-16 21:07:27 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-08-16 21:07:27 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-08-16 21:07:27 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-08-16 21:07:27 [DEBUG   ] Got command RPT from MCS: ref #256
2018-08-16 21:07:27 [DEBUG   ] summary = BOOTING
2018-08-16 21:07:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      256  15 58346 76047401 ABOOTINGBOOTING'
2018-08-16 21:07:27 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-08-16 21:07:27 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-08-16 21:07:27 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-08-16 21:07:27 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-08-16 21:07:27 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-08-16 21:07:28 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-08-16 21:07:28 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-08-16 21:07:28 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-08-16 21:07:28 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-08-16 21:07:28 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-08-16 21:07:28 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-08-16 21:07:28 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-08-16 21:07:28 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-08-16 21:07:28 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-08-16 21:07:29 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-08-16 21:07:29 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-08-16 21:07:29 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-08-16 21:07:29 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-08-16 21:07:29 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-08-16 21:07:29 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-08-16 21:07:29 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-08-16 21:07:29 [INFO    ] All xbars set
2018-08-16 21:07:29 [INFO    ] Setting adder chain routing for all beams
2018-08-16 21:07:34 [INFO    ] Setting beam ids
2018-08-16 21:07:44 [INFO    ] Starting beam delay calibration
2018-08-16 21:07:56 [INFO    ] Beam 1 latency is 5704
2018-08-16 21:07:56 [INFO    ] Beam 2 latency is 5752
2018-08-16 21:07:56 [INFO    ] Beam 3 latency is 5726
2018-08-16 21:07:56 [INFO    ] Beam 4 latency is 5717
2018-08-16 21:07:56 [INFO    ] Stop calibration
2018-08-16 21:08:04 [INFO    ] Beam delay calibration successful
2018-08-16 21:08:04 [INFO    ] Calibration passed
2018-08-16 21:08:04 [DEBUG   ] spawn_process: at 2018-08-16 21:08:04 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-08-16 21:08:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-08-16 21:08:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-08-16 21:08:05 [DEBUG   ] spawn_process: at 2018-08-16 21:08:05 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-08-16 21:08:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-08-16 21:08:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-08-16 21:08:05 [DEBUG   ] spawn_process: at 2018-08-16 21:08:05 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-08-16 21:08:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-08-16 21:08:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-08-16 21:08:05 [DEBUG   ] spawn_process: at 2018-08-16 21:08:05 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-08-16 21:08:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-08-16 21:08:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-08-16 21:08:05 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 1 msec
2018-08-16 21:08:05 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 360 ms (1534453685.359 s) with PID 7530 and time 1534453686
2018-08-16 21:08:05 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is 1 msec
2018-08-16 21:08:05 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 447 ms (1534453685.447 s) with PID 7533 and time 1534453686
2018-08-16 21:08:06 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-16 21:08:06 [INFO    ] Started antennas statistics background thread
2018-08-16 21:08:06 [INFO    ] Started board flags background thread
2018-08-16 21:08:06 [INFO    ] Started BAM background thread
2018-08-16 21:08:06 [INFO    ] Finished the INI process (ref. #254) in 102.848 s
2018-08-16 21:08:07 [DEBUG   ] Finished updating board flags in 0.977 seconds
2018-08-16 21:08:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 21:08:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 21:09:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 21:09:07 [DEBUG   ] Finished updating board flags in 1.261 seconds
2018-08-16 21:09:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 21:09:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 21:10:03 [DEBUG   ] Got command RPT from MCS: ref #263
2018-08-16 21:10:03 [DEBUG   ] summary = NORMAL
2018-08-16 21:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      263  14 58346 76203473 A NORMALNORMAL'
2018-08-16 21:10:03 [DEBUG   ] Got command RPT from MCS: ref #264
2018-08-16 21:10:03 [DEBUG   ] info = System calibrated and operating normally
2018-08-16 21:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      264  48 58346 76203474 A NORMALSystem calibrated and operating normally'
2018-08-16 21:10:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 21:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2018-08-16 21:10:07 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-08-16 21:10:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 21:10:37 [DEBUG   ] Got command RPT from MCS: ref #280
2018-08-16 21:10:37 [DEBUG   ] summary = NORMAL
2018-08-16 21:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      280  14 58346 76237645 A NORMALNORMAL'
2018-08-16 21:10:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 21:10:53 [DEBUG   ] Got command TBN from MCS: ref #282
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-16 21:10:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN      282   8 58346 76253365 A NORMAL'
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1534453854']
2018-08-16 21:10:53 [DEBUG   ] spawn_process: at 2018-08-16 21:10:53 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1534453854']
2018-08-16 21:10:53 [INFO    ] Finished spawning TBN in 0.049 s
2018-08-16 21:11:06 [DEBUG   ] Finished updating ant stats in 0.670 seconds
2018-08-16 21:11:08 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-08-16 21:11:26 [DEBUG   ] Finished updating ant stats in 0.463 seconds
2018-08-16 21:11:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-16 21:11:59 [DEBUG   ] Got command TBW from MCS: ref #288
2018-08-16 21:11:59 [DEBUG   ] tbw = exited with status True, code 0x00
2018-08-16 21:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW      288   8 58346 76319558 A NORMAL'
2018-08-16 21:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-08-16 21:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-08-16 21:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-08-16 21:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-08-16 21:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-08-16 21:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-08-16 21:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-08-16 21:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-08-16 21:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-08-16 21:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-08-16 21:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-08-16 21:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-08-16 21:12:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-08-16 21:12:03 [DEBUG   ] spawn_process: at 2018-08-16 21:12:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-08-16 21:12:03 [INFO    ] Finished spawning TBW
2018-08-16 21:12:08 [DEBUG   ] Finished updating board flags in 1.725 seconds
2018-08-16 21:12:27 [DEBUG   ] Got command RPT from MCS: ref #292
2018-08-16 21:12:27 [DEBUG   ] summary = NORMAL
2018-08-16 21:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      292  14 58346 76347481 A NORMALNORMAL'
2018-08-16 21:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 21:13:08 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-08-16 21:13:51 [INFO    ] __waitForTBW - TBW finished in 108.638 s
2018-08-16 21:13:52 [DEBUG   ] Finished updating ant stats in 0.487 seconds
2018-08-16 21:13:52 [INFO    ] Started antennas statistics background thread
2018-08-16 21:13:52 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1534454034']
2018-08-16 21:13:52 [DEBUG   ] spawn_process: at 2018-08-16 21:13:52 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1534454034']
2018-08-16 21:13:52 [INFO    ] Finished spawning TBN in 0.052 s
2018-08-16 21:14:08 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-08-16 21:14:12 [DEBUG   ] Finished updating ant stats in 0.471 seconds
2018-08-16 21:14:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-16 21:14:53 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-16 21:15:03 [DEBUG   ] Got command RPT from MCS: ref #308
2018-08-16 21:15:03 [DEBUG   ] summary = NORMAL
2018-08-16 21:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      308  14 58346 76503465 A NORMALNORMAL'
2018-08-16 21:15:03 [DEBUG   ] Got command RPT from MCS: ref #309
2018-08-16 21:15:03 [DEBUG   ] info = System calibrated and operating normally
2018-08-16 21:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      309  48 58346 76503466 A NORMALSystem calibrated and operating normally'
2018-08-16 21:15:08 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-08-16 21:15:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 21:15:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 21:15:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 21:16:08 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-08-16 21:16:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 21:16:33 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2018-08-16 21:16:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 103305601
2018-08-16 21:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 103305601
2018-08-16 21:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 103305601
2018-08-16 21:17:08 [DEBUG   ] Finished updating board flags in 1.158 seconds
2018-08-16 21:17:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 21:17:27 [DEBUG   ] Got command RPT from MCS: ref #329
2018-08-16 21:17:27 [DEBUG   ] summary = NORMAL
2018-08-16 21:17:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      329  14 58346 76647553 A NORMALNORMAL'
2018-08-16 21:17:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 21:17:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2018-08-16 21:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2018-08-16 21:18:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2018-08-16 21:18:09 [DEBUG   ] Finished updating board flags in 2.083 seconds
2018-08-16 21:18:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 21:18:33 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-16 21:18:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-16 21:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:19:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 21:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:19:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 21:19:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 21:19:08 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-08-16 21:19:13 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-16 21:19:33 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-16 21:19:54 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-16 21:20:00 [DEBUG   ] Got command TBN from MCS: ref #330
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-16 21:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN      330   8 58346 76800234 A NORMAL'
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1534454401']
2018-08-16 21:20:00 [DEBUG   ] spawn_process: at 2018-08-16 21:20:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1534454401']
2018-08-16 21:20:00 [INFO    ] Finished spawning TBN in 0.053 s
2018-08-16 21:20:03 [DEBUG   ] Got command RPT from MCS: ref #331
2018-08-16 21:20:03 [DEBUG   ] summary = NORMAL
2018-08-16 21:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      331  14 58346 76803473 A NORMALNORMAL'
2018-08-16 21:20:03 [DEBUG   ] Got command RPT from MCS: ref #332
2018-08-16 21:20:03 [DEBUG   ] info = System calibrated and operating normally
2018-08-16 21:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      332  48 58346 76803474 A NORMALSystem calibrated and operating normally'
2018-08-16 21:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:20:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:20:09 [DEBUG   ] Finished updating board flags in 1.915 seconds
2018-08-16 21:20:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 21:20:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 21:20:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-16 21:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:21:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 21:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:21:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:21:09 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-08-16 21:21:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 21:21:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 21:21:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 21:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:22:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:22:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-08-16 21:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-16 21:22:09 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-08-16 21:22:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-16 21:22:27 [DEBUG   ] Got command RPT from MCS: ref #354
2018-08-16 21:22:27 [DEBUG   ] summary = ERROR
2018-08-16 21:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      354  13 58346 76947641 A  ERRORERROR'
2018-08-16 21:22:27 [DEBUG   ] Got command RPT from MCS: ref #355
2018-08-16 21:22:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:22:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      355  77 58346 76947833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:22:28 [DEBUG   ] Got command RPT from MCS: ref #356
2018-08-16 21:22:28 [DEBUG   ] summary = ERROR
2018-08-16 21:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      356  13 58346 76948037 A  ERRORERROR'
2018-08-16 21:22:28 [DEBUG   ] Got command RPT from MCS: ref #357
2018-08-16 21:22:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      357  77 58346 76948241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:22:28 [DEBUG   ] Got command RPT from MCS: ref #358
2018-08-16 21:22:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 21:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      358  12 58346 76948433 A  ERRORB˜™š'
2018-08-16 21:22:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-16 21:22:54 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-16 21:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:23:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 21:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:23:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:23:09 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-16 21:23:15 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-16 21:23:35 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-16 21:23:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 21:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:24:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:24:09 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-08-16 21:24:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 21:24:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 21:24:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 21:25:03 [DEBUG   ] Got command RPT from MCS: ref #368
2018-08-16 21:25:03 [DEBUG   ] summary = ERROR
2018-08-16 21:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      368  13 58346 77103469 A  ERRORERROR'
2018-08-16 21:25:03 [DEBUG   ] Got command RPT from MCS: ref #369
2018-08-16 21:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      369  77 58346 77103470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:25:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:25:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 21:25:09 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-08-16 21:25:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 21:25:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 21:25:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 21:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:26:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 21:26:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-08-16 21:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:26:09 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-16 21:26:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 21:26:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 21:26:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 21:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:27:09 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-08-16 21:27:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 21:27:27 [DEBUG   ] Got command RPT from MCS: ref #389
2018-08-16 21:27:27 [DEBUG   ] summary = ERROR
2018-08-16 21:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      389  13 58346 77247721 A  ERRORERROR'
2018-08-16 21:27:27 [DEBUG   ] Got command RPT from MCS: ref #390
2018-08-16 21:27:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      390  77 58346 77247914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:27:28 [DEBUG   ] Got command RPT from MCS: ref #391
2018-08-16 21:27:28 [DEBUG   ] summary = ERROR
2018-08-16 21:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      391  13 58346 77248117 A  ERRORERROR'
2018-08-16 21:27:28 [DEBUG   ] Got command RPT from MCS: ref #392
2018-08-16 21:27:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      392  77 58346 77248322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:27:28 [DEBUG   ] Got command RPT from MCS: ref #393
2018-08-16 21:27:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 21:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      393  12 58346 77248525 A  ERRORB˜™š'
2018-08-16 21:27:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 21:27:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-16 21:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:28:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 21:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:28:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 21:28:09 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-08-16 21:28:16 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-16 21:28:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-16 21:28:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 21:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:29:10 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-08-16 21:29:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 21:29:36 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 21:29:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-16 21:30:03 [DEBUG   ] Got command RPT from MCS: ref #398
2018-08-16 21:30:03 [DEBUG   ] summary = ERROR
2018-08-16 21:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      398  13 58346 77403469 A  ERRORERROR'
2018-08-16 21:30:03 [DEBUG   ] Got command RPT from MCS: ref #399
2018-08-16 21:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      399  77 58346 77403470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:30:10 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-08-16 21:30:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 21:30:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 21:30:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 21:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:31:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:31:10 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-08-16 21:31:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 21:31:36 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 21:31:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 21:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:32:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:32:10 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-08-16 21:32:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 21:32:27 [DEBUG   ] Got command RPT from MCS: ref #421
2018-08-16 21:32:27 [DEBUG   ] summary = ERROR
2018-08-16 21:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      421  13 58346 77547802 A  ERRORERROR'
2018-08-16 21:32:27 [DEBUG   ] Got command RPT from MCS: ref #422
2018-08-16 21:32:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      422  77 58346 77547993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:32:28 [DEBUG   ] Got command RPT from MCS: ref #423
2018-08-16 21:32:28 [DEBUG   ] summary = ERROR
2018-08-16 21:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      423  13 58346 77548197 A  ERRORERROR'
2018-08-16 21:32:28 [DEBUG   ] Got command RPT from MCS: ref #424
2018-08-16 21:32:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      424  77 58346 77548401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:32:28 [DEBUG   ] Got command RPT from MCS: ref #425
2018-08-16 21:32:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 21:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      425  12 58346 77548605 A  ERRORB˜™š'
2018-08-16 21:32:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-16 21:32:56 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-16 21:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:33:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:33:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 21:33:10 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-08-16 21:33:17 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-16 21:33:37 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 21:33:57 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-16 21:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:34:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:34:10 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-08-16 21:34:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-16 21:34:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 21:34:57 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 21:35:03 [DEBUG   ] Got command RPT from MCS: ref #431
2018-08-16 21:35:03 [DEBUG   ] summary = ERROR
2018-08-16 21:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      431  13 58346 77703473 A  ERRORERROR'
2018-08-16 21:35:03 [DEBUG   ] Got command RPT from MCS: ref #432
2018-08-16 21:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      432  77 58346 77703474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:35:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 21:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:35:10 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-08-16 21:35:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 21:35:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 21:35:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-16 21:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:36:10 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-08-16 21:36:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 21:36:37 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-16 21:36:57 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-16 21:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:37:10 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-08-16 21:37:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 21:37:27 [DEBUG   ] Got command RPT from MCS: ref #452
2018-08-16 21:37:27 [DEBUG   ] summary = ERROR
2018-08-16 21:37:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      452  13 58346 77847870 A  ERRORERROR'
2018-08-16 21:37:28 [DEBUG   ] Got command RPT from MCS: ref #453
2018-08-16 21:37:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      453  77 58346 77848073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:37:28 [DEBUG   ] Got command RPT from MCS: ref #454
2018-08-16 21:37:28 [DEBUG   ] summary = ERROR
2018-08-16 21:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      454  13 58346 77848277 A  ERRORERROR'
2018-08-16 21:37:28 [DEBUG   ] Got command RPT from MCS: ref #455
2018-08-16 21:37:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      455  77 58346 77848481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:37:28 [DEBUG   ] Got command RPT from MCS: ref #456
2018-08-16 21:37:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 21:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      456  12 58346 77848673 A  ERRORB˜™š'
2018-08-16 21:37:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 21:37:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 21:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:38:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 21:38:10 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-08-16 21:38:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 21:38:38 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-16 21:38:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 21:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:39:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 21:39:11 [DEBUG   ] Finished updating board flags in 2.067 seconds
2018-08-16 21:39:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-16 21:39:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-16 21:39:58 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-16 21:40:03 [DEBUG   ] Got command RPT from MCS: ref #461
2018-08-16 21:40:03 [DEBUG   ] summary = ERROR
2018-08-16 21:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      461  13 58346 78003473 A  ERRORERROR'
2018-08-16 21:40:03 [DEBUG   ] Got command RPT from MCS: ref #462
2018-08-16 21:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      462  77 58346 78003474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:40:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 21:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:40:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:40:11 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-08-16 21:40:19 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-16 21:40:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-16 21:40:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 21:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:41:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:41:11 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-08-16 21:41:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 21:41:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 21:41:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 21:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:42:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 21:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:42:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:42:11 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-08-16 21:42:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 21:42:27 [DEBUG   ] Got command RPT from MCS: ref #484
2018-08-16 21:42:27 [DEBUG   ] summary = ERROR
2018-08-16 21:42:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      484  13 58346 78147949 A  ERRORERROR'
2018-08-16 21:42:28 [DEBUG   ] Got command RPT from MCS: ref #485
2018-08-16 21:42:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      485  77 58346 78148153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:42:28 [DEBUG   ] Got command RPT from MCS: ref #486
2018-08-16 21:42:28 [DEBUG   ] summary = ERROR
2018-08-16 21:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      486  13 58346 78148357 A  ERRORERROR'
2018-08-16 21:42:28 [DEBUG   ] Got command RPT from MCS: ref #487
2018-08-16 21:42:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      487  77 58346 78148561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:42:28 [DEBUG   ] Got command RPT from MCS: ref #488
2018-08-16 21:42:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 21:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      488  12 58346 78148753 A  ERRORB˜™š'
2018-08-16 21:42:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 21:42:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 21:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:43:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:43:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 21:43:11 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-08-16 21:43:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 21:43:39 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-16 21:43:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 21:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:44:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:44:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 21:44:11 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-08-16 21:44:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 21:44:40 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-16 21:44:59 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-16 21:45:03 [DEBUG   ] Got command RPT from MCS: ref #498
2018-08-16 21:45:03 [DEBUG   ] summary = ERROR
2018-08-16 21:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      498  13 58346 78303481 A  ERRORERROR'
2018-08-16 21:45:03 [DEBUG   ] Got command RPT from MCS: ref #499
2018-08-16 21:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      499  77 58346 78303482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:45:11 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-08-16 21:45:20 [DEBUG   ] Finished updating ant stats in 1.384 seconds
2018-08-16 21:45:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 21:46:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 21:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:46:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 21:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:46:11 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-08-16 21:46:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 21:46:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 21:47:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 21:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:47:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 21:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:47:11 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-08-16 21:47:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 21:47:28 [DEBUG   ] Got command RPT from MCS: ref #519
2018-08-16 21:47:28 [DEBUG   ] summary = ERROR
2018-08-16 21:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      519  13 58346 78448033 A  ERRORERROR'
2018-08-16 21:47:28 [DEBUG   ] Got command RPT from MCS: ref #520
2018-08-16 21:47:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      520  77 58346 78448237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:47:28 [DEBUG   ] Got command RPT from MCS: ref #521
2018-08-16 21:47:28 [DEBUG   ] summary = ERROR
2018-08-16 21:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      521  13 58346 78448429 A  ERRORERROR'
2018-08-16 21:47:28 [DEBUG   ] Got command RPT from MCS: ref #522
2018-08-16 21:47:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      522  77 58346 78448633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:47:28 [DEBUG   ] Got command RPT from MCS: ref #523
2018-08-16 21:47:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 21:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      523  12 58346 78448837 A  ERRORB˜™š'
2018-08-16 21:47:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 21:48:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 21:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:48:11 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-08-16 21:48:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 21:48:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 21:49:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 21:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:49:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 21:49:12 [DEBUG   ] Finished updating board flags in 2.286 seconds
2018-08-16 21:49:20 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-16 21:49:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 21:50:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 21:50:03 [DEBUG   ] Got command RPT from MCS: ref #524
2018-08-16 21:50:03 [DEBUG   ] summary = ERROR
2018-08-16 21:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      524  13 58346 78603481 A  ERRORERROR'
2018-08-16 21:50:03 [DEBUG   ] Got command RPT from MCS: ref #525
2018-08-16 21:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      525  77 58346 78603482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:50:12 [DEBUG   ] Finished updating board flags in 2.103 seconds
2018-08-16 21:50:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 21:50:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 21:51:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 21:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:51:12 [DEBUG   ] Finished updating board flags in 2.039 seconds
2018-08-16 21:51:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 21:51:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 21:52:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 21:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:52:12 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-08-16 21:52:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 21:52:28 [DEBUG   ] Got command RPT from MCS: ref #547
2018-08-16 21:52:28 [DEBUG   ] summary = ERROR
2018-08-16 21:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      547  13 58346 78748113 A  ERRORERROR'
2018-08-16 21:52:28 [DEBUG   ] Got command RPT from MCS: ref #548
2018-08-16 21:52:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      548  77 58346 78748305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:52:28 [DEBUG   ] Got command RPT from MCS: ref #549
2018-08-16 21:52:28 [DEBUG   ] summary = ERROR
2018-08-16 21:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      549  13 58346 78748509 A  ERRORERROR'
2018-08-16 21:52:28 [DEBUG   ] Got command RPT from MCS: ref #550
2018-08-16 21:52:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      550  77 58346 78748713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:52:28 [DEBUG   ] Got command RPT from MCS: ref #551
2018-08-16 21:52:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 21:52:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      551  12 58346 78748905 A  ERRORB˜™š'
2018-08-16 21:52:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 21:53:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 21:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:53:12 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-08-16 21:53:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 21:53:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 21:54:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 21:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:54:12 [DEBUG   ] Finished updating board flags in 1.885 seconds
2018-08-16 21:54:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 21:54:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 21:55:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 21:55:03 [DEBUG   ] Got command RPT from MCS: ref #561
2018-08-16 21:55:03 [DEBUG   ] summary = ERROR
2018-08-16 21:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      561  13 58346 78903485 A  ERRORERROR'
2018-08-16 21:55:03 [DEBUG   ] Got command RPT from MCS: ref #562
2018-08-16 21:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      562  77 58346 78903486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:55:12 [DEBUG   ] Finished updating board flags in 1.730 seconds
2018-08-16 21:55:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 21:55:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 21:56:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 21:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:56:12 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-08-16 21:56:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 21:56:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 21:57:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 21:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:57:12 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-08-16 21:57:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 21:57:28 [DEBUG   ] Got command RPT from MCS: ref #582
2018-08-16 21:57:28 [DEBUG   ] summary = ERROR
2018-08-16 21:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      582  13 58346 79048181 A  ERRORERROR'
2018-08-16 21:57:28 [DEBUG   ] Got command RPT from MCS: ref #583
2018-08-16 21:57:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      583  77 58346 79048385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:57:28 [DEBUG   ] Got command RPT from MCS: ref #584
2018-08-16 21:57:28 [DEBUG   ] summary = ERROR
2018-08-16 21:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      584  13 58346 79048589 A  ERRORERROR'
2018-08-16 21:57:28 [DEBUG   ] Got command RPT from MCS: ref #585
2018-08-16 21:57:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 21:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      585  77 58346 79048793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 21:57:28 [DEBUG   ] Got command RPT from MCS: ref #586
2018-08-16 21:57:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 21:57:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      586  12 58346 79048985 A  ERRORB˜™š'
2018-08-16 21:57:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 21:58:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 21:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:58:12 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-08-16 21:58:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 21:58:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 21:59:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 21:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 21:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 21:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 21:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 21:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 21:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 21:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 21:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 21:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 21:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 21:59:12 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-08-16 21:59:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 21:59:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 22:00:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 22:00:03 [DEBUG   ] Got command RPT from MCS: ref #591
2018-08-16 22:00:03 [DEBUG   ] summary = ERROR
2018-08-16 22:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      591  13 58346 79203481 A  ERRORERROR'
2018-08-16 22:00:03 [DEBUG   ] Got command RPT from MCS: ref #592
2018-08-16 22:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      592  77 58346 79203482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:00:12 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-08-16 22:00:20 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-08-16 22:00:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-16 22:01:01 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-16 22:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:01:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:01:12 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-08-16 22:01:21 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-16 22:01:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 22:02:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 22:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:02:12 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-08-16 22:02:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 22:02:28 [DEBUG   ] Got command RPT from MCS: ref #614
2018-08-16 22:02:28 [DEBUG   ] summary = ERROR
2018-08-16 22:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      614  13 58346 79348269 A  ERRORERROR'
2018-08-16 22:02:28 [DEBUG   ] Got command RPT from MCS: ref #615
2018-08-16 22:02:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      615  77 58346 79348461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:02:28 [DEBUG   ] Got command RPT from MCS: ref #616
2018-08-16 22:02:28 [DEBUG   ] summary = ERROR
2018-08-16 22:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      616  13 58346 79348665 A  ERRORERROR'
2018-08-16 22:02:28 [DEBUG   ] Got command RPT from MCS: ref #617
2018-08-16 22:02:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:02:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      617  77 58346 79348869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:02:29 [DEBUG   ] Got command RPT from MCS: ref #618
2018-08-16 22:02:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      618  12 58346 79349061 A  ERRORB˜™š'
2018-08-16 22:02:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 22:03:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 22:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:03:12 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-08-16 22:03:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 22:03:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 22:04:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-16 22:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:04:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:04:13 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-08-16 22:04:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 22:04:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 22:05:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 22:05:03 [DEBUG   ] Got command RPT from MCS: ref #624
2018-08-16 22:05:03 [DEBUG   ] summary = ERROR
2018-08-16 22:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      624  13 58346 79503485 A  ERRORERROR'
2018-08-16 22:05:03 [DEBUG   ] Got command RPT from MCS: ref #625
2018-08-16 22:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      625  77 58346 79503486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:05:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:05:13 [DEBUG   ] Finished updating board flags in 2.123 seconds
2018-08-16 22:05:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 22:05:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 22:06:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 22:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:06:13 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-08-16 22:06:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 22:06:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 22:07:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 22:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:07:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:07:13 [DEBUG   ] Finished updating board flags in 1.947 seconds
2018-08-16 22:07:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-16 22:07:28 [DEBUG   ] Got command RPT from MCS: ref #645
2018-08-16 22:07:28 [DEBUG   ] summary = ERROR
2018-08-16 22:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      645  13 58346 79648341 A  ERRORERROR'
2018-08-16 22:07:28 [DEBUG   ] Got command RPT from MCS: ref #646
2018-08-16 22:07:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      646  77 58346 79648545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:07:28 [DEBUG   ] Got command RPT from MCS: ref #647
2018-08-16 22:07:28 [DEBUG   ] summary = ERROR
2018-08-16 22:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      647  13 58346 79648749 A  ERRORERROR'
2018-08-16 22:07:28 [DEBUG   ] Got command RPT from MCS: ref #648
2018-08-16 22:07:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:07:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      648  77 58346 79648941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:07:29 [DEBUG   ] Got command RPT from MCS: ref #649
2018-08-16 22:07:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      649  12 58346 79649145 A  ERRORB˜™š'
2018-08-16 22:07:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 22:08:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-16 22:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 22:08:13 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-08-16 22:08:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 22:08:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 22:09:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 22:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:09:13 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-08-16 22:09:22 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-16 22:09:42 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 22:10:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 22:10:03 [DEBUG   ] Got command RPT from MCS: ref #654
2018-08-16 22:10:03 [DEBUG   ] summary = ERROR
2018-08-16 22:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      654  13 58346 79803481 A  ERRORERROR'
2018-08-16 22:10:03 [DEBUG   ] Got command RPT from MCS: ref #655
2018-08-16 22:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      655  77 58346 79803482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:10:13 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-16 22:10:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 22:10:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 22:11:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 22:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:11:13 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-08-16 22:11:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-16 22:11:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-16 22:12:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 22:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:12:13 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-08-16 22:12:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 22:12:28 [DEBUG   ] Got command RPT from MCS: ref #677
2018-08-16 22:12:28 [DEBUG   ] summary = ERROR
2018-08-16 22:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      677  13 58346 79948425 A  ERRORERROR'
2018-08-16 22:12:28 [DEBUG   ] Got command RPT from MCS: ref #678
2018-08-16 22:12:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      678  77 58346 79948617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:12:28 [DEBUG   ] Got command RPT from MCS: ref #679
2018-08-16 22:12:28 [DEBUG   ] summary = ERROR
2018-08-16 22:12:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      679  13 58346 79948821 A  ERRORERROR'
2018-08-16 22:12:29 [DEBUG   ] Got command RPT from MCS: ref #680
2018-08-16 22:12:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      680  77 58346 79949025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:12:29 [DEBUG   ] Got command RPT from MCS: ref #681
2018-08-16 22:12:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      681  12 58346 79949229 A  ERRORB˜™š'
2018-08-16 22:12:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 22:13:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 22:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 22:13:13 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-08-16 22:13:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 22:13:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 22:14:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 22:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:14:13 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-16 22:14:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-16 22:14:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 22:15:03 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-16 22:15:03 [DEBUG   ] Got command RPT from MCS: ref #691
2018-08-16 22:15:03 [DEBUG   ] summary = ERROR
2018-08-16 22:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      691  13 58346 80103481 A  ERRORERROR'
2018-08-16 22:15:03 [DEBUG   ] Got command RPT from MCS: ref #692
2018-08-16 22:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      692  77 58346 80103482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 22:15:13 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-08-16 22:15:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-16 22:15:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 22:16:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 22:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:16:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:16:13 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-08-16 22:16:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 22:16:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 22:17:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 22:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:17:14 [DEBUG   ] Finished updating board flags in 2.122 seconds
2018-08-16 22:17:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 22:17:28 [DEBUG   ] Got command RPT from MCS: ref #712
2018-08-16 22:17:28 [DEBUG   ] summary = ERROR
2018-08-16 22:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      712  13 58346 80248501 A  ERRORERROR'
2018-08-16 22:17:28 [DEBUG   ] Got command RPT from MCS: ref #713
2018-08-16 22:17:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      713  77 58346 80248705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:17:28 [DEBUG   ] Got command RPT from MCS: ref #714
2018-08-16 22:17:28 [DEBUG   ] summary = ERROR
2018-08-16 22:17:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      714  13 58346 80248897 A  ERRORERROR'
2018-08-16 22:17:29 [DEBUG   ] Got command RPT from MCS: ref #715
2018-08-16 22:17:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      715  77 58346 80249101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:17:29 [DEBUG   ] Got command RPT from MCS: ref #716
2018-08-16 22:17:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      716  12 58346 80249305 A  ERRORB˜™š'
2018-08-16 22:17:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 22:18:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 22:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 22:18:14 [DEBUG   ] Finished updating board flags in 1.950 seconds
2018-08-16 22:18:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 22:18:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 22:19:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 22:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 22:19:14 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-08-16 22:19:23 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 22:19:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 22:20:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 22:20:03 [DEBUG   ] Got command RPT from MCS: ref #717
2018-08-16 22:20:03 [DEBUG   ] summary = ERROR
2018-08-16 22:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      717  13 58346 80403481 A  ERRORERROR'
2018-08-16 22:20:03 [DEBUG   ] Got command RPT from MCS: ref #718
2018-08-16 22:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      718  77 58346 80403482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:20:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:20:14 [DEBUG   ] Finished updating board flags in 1.757 seconds
2018-08-16 22:20:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 22:20:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 22:21:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 22:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:21:14 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-08-16 22:21:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 22:21:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 22:22:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-16 22:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:22:14 [DEBUG   ] Finished updating board flags in 1.560 seconds
2018-08-16 22:22:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 22:22:28 [DEBUG   ] Got command RPT from MCS: ref #740
2018-08-16 22:22:28 [DEBUG   ] summary = ERROR
2018-08-16 22:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      740  13 58346 80548573 A  ERRORERROR'
2018-08-16 22:22:28 [DEBUG   ] Got command RPT from MCS: ref #741
2018-08-16 22:22:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      741  77 58346 80548777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:22:28 [DEBUG   ] Got command RPT from MCS: ref #742
2018-08-16 22:22:28 [DEBUG   ] summary = ERROR
2018-08-16 22:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      742  13 58346 80548981 A  ERRORERROR'
2018-08-16 22:22:29 [DEBUG   ] Got command RPT from MCS: ref #743
2018-08-16 22:22:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      743  77 58346 80549185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:22:29 [DEBUG   ] Got command RPT from MCS: ref #744
2018-08-16 22:22:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      744  12 58346 80549377 A  ERRORB˜™š'
2018-08-16 22:22:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 22:23:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-16 22:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:23:14 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-08-16 22:23:24 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-08-16 22:23:44 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-16 22:24:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 22:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:24:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:24:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 22:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:24:14 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-08-16 22:24:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 22:24:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 22:25:03 [DEBUG   ] Got command RPT from MCS: ref #754
2018-08-16 22:25:03 [DEBUG   ] summary = ERROR
2018-08-16 22:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      754  13 58346 80703490 A  ERRORERROR'
2018-08-16 22:25:03 [DEBUG   ] Got command RPT from MCS: ref #755
2018-08-16 22:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      755  77 58346 80703490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:25:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 22:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:25:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:25:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 22:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:25:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 22:25:14 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-08-16 22:25:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-16 22:25:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 22:26:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 22:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:26:14 [DEBUG   ] Finished updating board flags in 1.319 seconds
2018-08-16 22:26:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 22:26:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 22:27:04 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-16 22:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:27:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:27:15 [DEBUG   ] Finished updating board flags in 2.106 seconds
2018-08-16 22:27:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 22:27:28 [DEBUG   ] Got command RPT from MCS: ref #775
2018-08-16 22:27:28 [DEBUG   ] summary = ERROR
2018-08-16 22:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      775  13 58346 80848657 A  ERRORERROR'
2018-08-16 22:27:28 [DEBUG   ] Got command RPT from MCS: ref #776
2018-08-16 22:27:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      776  77 58346 80848861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:27:29 [DEBUG   ] Got command RPT from MCS: ref #777
2018-08-16 22:27:29 [DEBUG   ] summary = ERROR
2018-08-16 22:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      777  13 58346 80849066 A  ERRORERROR'
2018-08-16 22:27:29 [DEBUG   ] Got command RPT from MCS: ref #778
2018-08-16 22:27:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      778  77 58346 80849257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:27:29 [DEBUG   ] Got command RPT from MCS: ref #779
2018-08-16 22:27:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      779  12 58346 80849461 A  ERRORB˜™š'
2018-08-16 22:27:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 22:28:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-16 22:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:28:15 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-08-16 22:28:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 22:28:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 22:29:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 22:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:29:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 22:29:15 [DEBUG   ] Finished updating board flags in 1.839 seconds
2018-08-16 22:29:24 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-16 22:29:45 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-16 22:30:03 [DEBUG   ] Got command RPT from MCS: ref #784
2018-08-16 22:30:03 [DEBUG   ] summary = ERROR
2018-08-16 22:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      784  13 58346 81003489 A  ERRORERROR'
2018-08-16 22:30:03 [DEBUG   ] Got command RPT from MCS: ref #785
2018-08-16 22:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      785  77 58346 81003490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:30:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-16 22:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:30:15 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-08-16 22:30:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 22:30:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 22:31:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-16 22:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:31:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:31:15 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-08-16 22:31:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-16 22:31:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 22:32:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 22:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:32:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 22:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:32:15 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-08-16 22:32:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 22:32:28 [DEBUG   ] Got command RPT from MCS: ref #807
2018-08-16 22:32:28 [DEBUG   ] summary = ERROR
2018-08-16 22:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      807  13 58346 81148741 A  ERRORERROR'
2018-08-16 22:32:28 [DEBUG   ] Got command RPT from MCS: ref #808
2018-08-16 22:32:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:32:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      808  77 58346 81148941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:32:29 [DEBUG   ] Got command RPT from MCS: ref #809
2018-08-16 22:32:29 [DEBUG   ] summary = ERROR
2018-08-16 22:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      809  13 58346 81149141 A  ERRORERROR'
2018-08-16 22:32:29 [DEBUG   ] Got command RPT from MCS: ref #810
2018-08-16 22:32:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      810  77 58346 81149345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:32:29 [DEBUG   ] Got command RPT from MCS: ref #811
2018-08-16 22:32:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      811  12 58346 81149537 A  ERRORB˜™š'
2018-08-16 22:32:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 22:33:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 22:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:33:15 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-08-16 22:33:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 22:33:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 22:34:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 22:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:34:15 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-08-16 22:34:25 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-16 22:34:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 22:35:03 [DEBUG   ] Got command RPT from MCS: ref #817
2018-08-16 22:35:03 [DEBUG   ] summary = ERROR
2018-08-16 22:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      817  13 58346 81303493 A  ERRORERROR'
2018-08-16 22:35:03 [DEBUG   ] Got command RPT from MCS: ref #818
2018-08-16 22:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      818  77 58346 81303494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:35:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 22:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:35:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:35:15 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-08-16 22:35:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-16 22:35:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-16 22:36:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 22:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:36:15 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-08-16 22:36:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-16 22:36:46 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 22:37:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 22:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:37:15 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-08-16 22:37:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 22:37:28 [DEBUG   ] Got command RPT from MCS: ref #838
2018-08-16 22:37:28 [DEBUG   ] summary = ERROR
2018-08-16 22:37:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      838  13 58346 81448829 A  ERRORERROR'
2018-08-16 22:37:29 [DEBUG   ] Got command RPT from MCS: ref #839
2018-08-16 22:37:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      839  77 58346 81449021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:37:29 [DEBUG   ] Got command RPT from MCS: ref #840
2018-08-16 22:37:29 [DEBUG   ] summary = ERROR
2018-08-16 22:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      840  13 58346 81449225 A  ERRORERROR'
2018-08-16 22:37:29 [DEBUG   ] Got command RPT from MCS: ref #841
2018-08-16 22:37:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      841  77 58346 81449429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:37:29 [DEBUG   ] Got command RPT from MCS: ref #842
2018-08-16 22:37:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      842  12 58346 81449621 A  ERRORB˜™š'
2018-08-16 22:37:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 22:38:06 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-16 22:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:38:15 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-08-16 22:38:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 22:38:47 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-16 22:39:07 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-16 22:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:39:16 [DEBUG   ] Finished updating board flags in 2.039 seconds
2018-08-16 22:39:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 22:39:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 22:40:03 [DEBUG   ] Got command RPT from MCS: ref #847
2018-08-16 22:40:03 [DEBUG   ] summary = ERROR
2018-08-16 22:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      847  13 58346 81603493 A  ERRORERROR'
2018-08-16 22:40:03 [DEBUG   ] Got command RPT from MCS: ref #848
2018-08-16 22:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      848  77 58346 81603494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:40:07 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 22:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:40:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 22:40:16 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-08-16 22:40:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 22:40:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 22:41:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-16 22:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:41:16 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-08-16 22:41:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 22:41:48 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-16 22:42:07 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2018-08-16 22:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:42:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 22:42:16 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-08-16 22:42:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-16 22:42:28 [DEBUG   ] Got command RPT from MCS: ref #870
2018-08-16 22:42:28 [DEBUG   ] summary = ERROR
2018-08-16 22:42:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      870  13 58346 81748913 A  ERRORERROR'
2018-08-16 22:42:29 [DEBUG   ] Got command RPT from MCS: ref #871
2018-08-16 22:42:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      871  77 58346 81749105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:42:29 [DEBUG   ] Got command RPT from MCS: ref #872
2018-08-16 22:42:29 [DEBUG   ] summary = ERROR
2018-08-16 22:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      872  13 58346 81749309 A  ERRORERROR'
2018-08-16 22:42:29 [DEBUG   ] Got command RPT from MCS: ref #873
2018-08-16 22:42:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      873  77 58346 81749513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:42:29 [DEBUG   ] Got command RPT from MCS: ref #874
2018-08-16 22:42:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      874  12 58346 81749717 A  ERRORB˜™š'
2018-08-16 22:42:47 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-16 22:43:08 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 22:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:43:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:43:16 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-08-16 22:43:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 22:43:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 22:44:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 22:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:44:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:44:16 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-08-16 22:44:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 22:44:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 22:45:03 [DEBUG   ] Got command RPT from MCS: ref #884
2018-08-16 22:45:03 [DEBUG   ] summary = ERROR
2018-08-16 22:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      884  13 58346 81903493 A  ERRORERROR'
2018-08-16 22:45:03 [DEBUG   ] Got command RPT from MCS: ref #885
2018-08-16 22:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      885  77 58346 81903494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:45:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-16 22:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:45:16 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-08-16 22:45:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 22:45:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 22:46:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 22:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:46:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:46:16 [DEBUG   ] Finished updating board flags in 1.679 seconds
2018-08-16 22:46:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 22:46:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 22:47:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 22:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 22:47:16 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-08-16 22:47:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 22:47:28 [DEBUG   ] Got command RPT from MCS: ref #905
2018-08-16 22:47:28 [DEBUG   ] summary = ERROR
2018-08-16 22:47:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      905  13 58346 82048997 A  ERRORERROR'
2018-08-16 22:47:29 [DEBUG   ] Got command RPT from MCS: ref #906
2018-08-16 22:47:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      906  77 58346 82049201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:47:29 [DEBUG   ] Got command RPT from MCS: ref #907
2018-08-16 22:47:29 [DEBUG   ] summary = ERROR
2018-08-16 22:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      907  13 58346 82049393 A  ERRORERROR'
2018-08-16 22:47:29 [DEBUG   ] Got command RPT from MCS: ref #908
2018-08-16 22:47:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      908  77 58346 82049597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:47:29 [DEBUG   ] Got command RPT from MCS: ref #909
2018-08-16 22:47:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      909  12 58346 82049801 A  ERRORB˜™š'
2018-08-16 22:47:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 22:48:08 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 22:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:48:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 22:48:16 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-08-16 22:48:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-16 22:48:49 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 22:49:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 22:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:49:16 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-08-16 22:49:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 22:49:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-16 22:50:03 [DEBUG   ] Got command RPT from MCS: ref #910
2018-08-16 22:50:03 [DEBUG   ] summary = ERROR
2018-08-16 22:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      910  13 58346 82203497 A  ERRORERROR'
2018-08-16 22:50:03 [DEBUG   ] Got command RPT from MCS: ref #911
2018-08-16 22:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      911  77 58346 82203498 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:50:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 22:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:50:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 22:50:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 22:50:16 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-08-16 22:50:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 22:50:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 22:51:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 22:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:51:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:51:16 [DEBUG   ] Finished updating board flags in 1.320 seconds
2018-08-16 22:51:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 22:51:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 22:52:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-16 22:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:52:17 [DEBUG   ] Finished updating board flags in 2.104 seconds
2018-08-16 22:52:29 [DEBUG   ] Got command RPT from MCS: ref #933
2018-08-16 22:52:29 [DEBUG   ] summary = ERROR
2018-08-16 22:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      933  13 58346 82349081 A  ERRORERROR'
2018-08-16 22:52:29 [DEBUG   ] Got command RPT from MCS: ref #934
2018-08-16 22:52:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      934  77 58346 82349285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:52:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-16 22:52:29 [DEBUG   ] Got command RPT from MCS: ref #935
2018-08-16 22:52:29 [DEBUG   ] summary = ERROR
2018-08-16 22:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      935  13 58346 82349477 A  ERRORERROR'
2018-08-16 22:52:29 [DEBUG   ] Got command RPT from MCS: ref #936
2018-08-16 22:52:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      936  77 58346 82349681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:52:29 [DEBUG   ] Got command RPT from MCS: ref #937
2018-08-16 22:52:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:52:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      937  12 58346 82349885 A  ERRORB˜™š'
2018-08-16 22:52:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 22:53:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 22:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:53:17 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-08-16 22:53:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 22:53:50 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 22:54:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 22:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:54:17 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-08-16 22:54:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-16 22:54:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-16 22:55:03 [DEBUG   ] Got command RPT from MCS: ref #947
2018-08-16 22:55:03 [DEBUG   ] summary = ERROR
2018-08-16 22:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      947  13 58346 82503501 A  ERRORERROR'
2018-08-16 22:55:03 [DEBUG   ] Got command RPT from MCS: ref #948
2018-08-16 22:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      948  77 58346 82503502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:55:10 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-16 22:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:55:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 22:55:17 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-16 22:55:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 22:55:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 22:56:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 22:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:56:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 22:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:56:17 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-16 22:56:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 22:56:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 22:57:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-16 22:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:57:17 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-08-16 22:57:29 [DEBUG   ] Got command RPT from MCS: ref #968
2018-08-16 22:57:29 [DEBUG   ] summary = ERROR
2018-08-16 22:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      968  13 58346 82649165 A  ERRORERROR'
2018-08-16 22:57:29 [DEBUG   ] Got command RPT from MCS: ref #969
2018-08-16 22:57:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      969  77 58346 82649369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:57:29 [DEBUG   ] Got command RPT from MCS: ref #970
2018-08-16 22:57:29 [DEBUG   ] summary = ERROR
2018-08-16 22:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      970  13 58346 82649561 A  ERRORERROR'
2018-08-16 22:57:29 [DEBUG   ] Got command RPT from MCS: ref #971
2018-08-16 22:57:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 22:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      971  77 58346 82649766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 22:57:29 [DEBUG   ] Got command RPT from MCS: ref #972
2018-08-16 22:57:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 22:57:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      972  12 58346 82649969 A  ERRORB˜™š'
2018-08-16 22:57:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-16 22:57:50 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-08-16 22:58:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 22:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:58:17 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-08-16 22:58:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 22:58:51 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-16 22:59:10 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-08-16 22:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 22:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 22:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 22:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 22:59:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 22:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 22:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 22:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 22:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 22:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 22:59:18 [DEBUG   ] Finished updating board flags in 2.201 seconds
2018-08-16 22:59:31 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-16 22:59:51 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-16 23:00:03 [DEBUG   ] Got command RPT from MCS: ref #977
2018-08-16 23:00:03 [DEBUG   ] summary = ERROR
2018-08-16 23:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      977  13 58346 82803505 A  ERRORERROR'
2018-08-16 23:00:03 [DEBUG   ] Got command RPT from MCS: ref #978
2018-08-16 23:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT      978  77 58346 82803506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:00:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:00:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:00:17 [DEBUG   ] Finished updating board flags in 1.320 seconds
2018-08-16 23:00:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:00:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 23:01:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-16 23:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:01:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:01:18 [DEBUG   ] Finished updating board flags in 2.092 seconds
2018-08-16 23:01:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 23:01:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 23:02:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 23:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:02:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:02:18 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-08-16 23:02:29 [DEBUG   ] Got command RPT from MCS: ref #1000
2018-08-16 23:02:29 [DEBUG   ] summary = ERROR
2018-08-16 23:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1000  13 58346 82949249 A  ERRORERROR'
2018-08-16 23:02:29 [DEBUG   ] Got command RPT from MCS: ref #1001
2018-08-16 23:02:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1001  77 58346 82949453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:02:29 [DEBUG   ] Got command RPT from MCS: ref #1002
2018-08-16 23:02:29 [DEBUG   ] summary = ERROR
2018-08-16 23:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1002  13 58346 82949645 A  ERRORERROR'
2018-08-16 23:02:29 [DEBUG   ] Got command RPT from MCS: ref #1003
2018-08-16 23:02:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1003  77 58346 82949849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:02:30 [DEBUG   ] Got command RPT from MCS: ref #1004
2018-08-16 23:02:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1004  12 58346 82950053 A  ERRORB˜™š'
2018-08-16 23:02:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-16 23:02:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:03:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:03:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:03:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:03:18 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-08-16 23:03:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 23:03:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:04:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:04:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:04:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 23:04:18 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-08-16 23:04:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:04:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 23:05:03 [DEBUG   ] Got command RPT from MCS: ref #1010
2018-08-16 23:05:03 [DEBUG   ] summary = ERROR
2018-08-16 23:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1010  13 58346 83103501 A  ERRORERROR'
2018-08-16 23:05:03 [DEBUG   ] Got command RPT from MCS: ref #1011
2018-08-16 23:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1011  77 58346 83103502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:05:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 23:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:05:18 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-08-16 23:05:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 23:05:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 23:06:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 23:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:06:18 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-08-16 23:06:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-16 23:06:52 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-16 23:07:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 23:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:07:18 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-08-16 23:07:29 [DEBUG   ] Got command RPT from MCS: ref #1031
2018-08-16 23:07:29 [DEBUG   ] summary = ERROR
2018-08-16 23:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1031  13 58346 83249329 A  ERRORERROR'
2018-08-16 23:07:29 [DEBUG   ] Got command RPT from MCS: ref #1032
2018-08-16 23:07:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1032  77 58346 83249533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:07:29 [DEBUG   ] Got command RPT from MCS: ref #1033
2018-08-16 23:07:29 [DEBUG   ] summary = ERROR
2018-08-16 23:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1033  13 58346 83249737 A  ERRORERROR'
2018-08-16 23:07:29 [DEBUG   ] Got command RPT from MCS: ref #1034
2018-08-16 23:07:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1034  77 58346 83249941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:07:30 [DEBUG   ] Got command RPT from MCS: ref #1035
2018-08-16 23:07:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1035  12 58346 83250133 A  ERRORB˜™š'
2018-08-16 23:07:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-16 23:07:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:08:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:08:19 [DEBUG   ] Finished updating board flags in 2.279 seconds
2018-08-16 23:08:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 23:08:52 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-16 23:09:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 23:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:09:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:09:19 [DEBUG   ] Finished updating board flags in 2.100 seconds
2018-08-16 23:09:32 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-16 23:09:52 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-16 23:10:03 [DEBUG   ] Got command RPT from MCS: ref #1040
2018-08-16 23:10:03 [DEBUG   ] summary = ERROR
2018-08-16 23:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1040  13 58346 83403501 A  ERRORERROR'
2018-08-16 23:10:03 [DEBUG   ] Got command RPT from MCS: ref #1041
2018-08-16 23:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1041  77 58346 83403502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:10:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 23:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:10:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:10:19 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-08-16 23:10:32 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-16 23:10:52 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 23:11:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 23:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:11:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 23:11:19 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-08-16 23:11:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-16 23:11:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 23:12:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:12:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:12:19 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-08-16 23:12:29 [DEBUG   ] Got command RPT from MCS: ref #1063
2018-08-16 23:12:29 [DEBUG   ] summary = ERROR
2018-08-16 23:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1063  13 58346 83549417 A  ERRORERROR'
2018-08-16 23:12:29 [DEBUG   ] Got command RPT from MCS: ref #1064
2018-08-16 23:12:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1064  77 58346 83549621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:12:29 [DEBUG   ] Got command RPT from MCS: ref #1065
2018-08-16 23:12:29 [DEBUG   ] summary = ERROR
2018-08-16 23:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1065  13 58346 83549825 A  ERRORERROR'
2018-08-16 23:12:30 [DEBUG   ] Got command RPT from MCS: ref #1066
2018-08-16 23:12:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1066  77 58346 83550017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:12:30 [DEBUG   ] Got command RPT from MCS: ref #1067
2018-08-16 23:12:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1067  12 58346 83550221 A  ERRORB˜™š'
2018-08-16 23:12:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:12:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:13:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 23:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:13:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:13:19 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-16 23:13:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 23:13:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 23:14:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 23:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:14:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:14:19 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-08-16 23:14:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 23:14:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 23:15:03 [DEBUG   ] Got command RPT from MCS: ref #1077
2018-08-16 23:15:03 [DEBUG   ] summary = ERROR
2018-08-16 23:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1077  13 58346 83703509 A  ERRORERROR'
2018-08-16 23:15:03 [DEBUG   ] Got command RPT from MCS: ref #1078
2018-08-16 23:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1078  77 58346 83703510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:15:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 23:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:15:19 [DEBUG   ] Finished updating board flags in 1.646 seconds
2018-08-16 23:15:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-16 23:15:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-16 23:16:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-16 23:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:16:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 23:16:19 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-08-16 23:16:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:16:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:17:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:17:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 23:17:19 [DEBUG   ] Finished updating board flags in 1.480 seconds
2018-08-16 23:17:29 [DEBUG   ] Got command RPT from MCS: ref #1098
2018-08-16 23:17:29 [DEBUG   ] summary = ERROR
2018-08-16 23:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1098  13 58346 83849505 A  ERRORERROR'
2018-08-16 23:17:29 [DEBUG   ] Got command RPT from MCS: ref #1099
2018-08-16 23:17:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1099  77 58346 83849709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:17:29 [DEBUG   ] Got command RPT from MCS: ref #1100
2018-08-16 23:17:29 [DEBUG   ] summary = ERROR
2018-08-16 23:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1100  13 58346 83849901 A  ERRORERROR'
2018-08-16 23:17:30 [DEBUG   ] Got command RPT from MCS: ref #1101
2018-08-16 23:17:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1101  77 58346 83850105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:17:30 [DEBUG   ] Got command RPT from MCS: ref #1102
2018-08-16 23:17:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1102  12 58346 83850309 A  ERRORB˜™š'
2018-08-16 23:17:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:17:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:18:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:18:19 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-08-16 23:18:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 23:18:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 23:19:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 23:19:20 [DEBUG   ] Finished updating board flags in 2.280 seconds
2018-08-16 23:19:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 23:19:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 23:20:03 [DEBUG   ] Got command RPT from MCS: ref #1103
2018-08-16 23:20:03 [DEBUG   ] summary = ERROR
2018-08-16 23:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1103  13 58346 84003505 A  ERRORERROR'
2018-08-16 23:20:03 [DEBUG   ] Got command RPT from MCS: ref #1104
2018-08-16 23:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1104  77 58346 84003506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:20:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:20:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:20:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 23:20:20 [DEBUG   ] Finished updating board flags in 2.109 seconds
2018-08-16 23:20:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:20:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:21:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 23:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:21:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:21:20 [DEBUG   ] Finished updating board flags in 2.031 seconds
2018-08-16 23:21:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:21:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:22:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 23:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:22:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:22:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:22:20 [DEBUG   ] Finished updating board flags in 1.972 seconds
2018-08-16 23:22:29 [DEBUG   ] Got command RPT from MCS: ref #1126
2018-08-16 23:22:29 [DEBUG   ] summary = ERROR
2018-08-16 23:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1126  13 58346 84149593 A  ERRORERROR'
2018-08-16 23:22:29 [DEBUG   ] Got command RPT from MCS: ref #1127
2018-08-16 23:22:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1127  77 58346 84149785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:22:29 [DEBUG   ] Got command RPT from MCS: ref #1128
2018-08-16 23:22:29 [DEBUG   ] summary = ERROR
2018-08-16 23:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1128  13 58346 84149989 A  ERRORERROR'
2018-08-16 23:22:30 [DEBUG   ] Got command RPT from MCS: ref #1129
2018-08-16 23:22:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1129  77 58346 84150193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:22:30 [DEBUG   ] Got command RPT from MCS: ref #1130
2018-08-16 23:22:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1130  12 58346 84150397 A  ERRORB˜™š'
2018-08-16 23:22:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-16 23:22:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:23:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:23:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:23:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:23:20 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-08-16 23:23:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 23:23:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:24:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:24:19 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:24:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:24:20 [DEBUG   ] Finished updating board flags in 1.876 seconds
2018-08-16 23:24:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 23:24:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 23:25:03 [DEBUG   ] Got command RPT from MCS: ref #1140
2018-08-16 23:25:03 [DEBUG   ] summary = ERROR
2018-08-16 23:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1140  13 58346 84303505 A  ERRORERROR'
2018-08-16 23:25:03 [DEBUG   ] Got command RPT from MCS: ref #1141
2018-08-16 23:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1141  77 58346 84303506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:25:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 23:25:20 [DEBUG   ] Finished updating board flags in 1.708 seconds
2018-08-16 23:25:33 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-16 23:25:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 23:26:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 23:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:26:20 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-08-16 23:26:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-16 23:26:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 23:27:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 23:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:27:20 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-08-16 23:27:29 [DEBUG   ] Got command RPT from MCS: ref #1161
2018-08-16 23:27:29 [DEBUG   ] summary = ERROR
2018-08-16 23:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1161  13 58346 84449669 A  ERRORERROR'
2018-08-16 23:27:29 [DEBUG   ] Got command RPT from MCS: ref #1162
2018-08-16 23:27:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1162  77 58346 84449873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:27:30 [DEBUG   ] Got command RPT from MCS: ref #1163
2018-08-16 23:27:30 [DEBUG   ] summary = ERROR
2018-08-16 23:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1163  13 58346 84450077 A  ERRORERROR'
2018-08-16 23:27:30 [DEBUG   ] Got command RPT from MCS: ref #1164
2018-08-16 23:27:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1164  77 58346 84450269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:27:30 [DEBUG   ] Got command RPT from MCS: ref #1165
2018-08-16 23:27:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1165  12 58346 84450473 A  ERRORB˜™š'
2018-08-16 23:27:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-16 23:27:54 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-16 23:28:14 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-16 23:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:28:20 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-08-16 23:28:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:28:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-16 23:29:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-16 23:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:29:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:29:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:29:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 23:29:20 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-08-16 23:29:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-16 23:29:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:30:03 [DEBUG   ] Got command RPT from MCS: ref #1170
2018-08-16 23:30:03 [DEBUG   ] summary = ERROR
2018-08-16 23:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1170  13 58346 84603509 A  ERRORERROR'
2018-08-16 23:30:03 [DEBUG   ] Got command RPT from MCS: ref #1171
2018-08-16 23:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1171  77 58346 84603510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:30:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:30:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:30:21 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-08-16 23:30:34 [DEBUG   ] Finished updating ant stats in 0.513 seconds
2018-08-16 23:30:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-16 23:31:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 23:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:31:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:31:21 [DEBUG   ] Finished updating board flags in 1.839 seconds
2018-08-16 23:31:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:31:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:32:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:32:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 23:32:21 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-08-16 23:32:29 [DEBUG   ] Got command RPT from MCS: ref #1193
2018-08-16 23:32:29 [DEBUG   ] summary = ERROR
2018-08-16 23:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1193  13 58346 84749753 A  ERRORERROR'
2018-08-16 23:32:29 [DEBUG   ] Got command RPT from MCS: ref #1194
2018-08-16 23:32:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:32:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1194  77 58346 84749957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:32:30 [DEBUG   ] Got command RPT from MCS: ref #1195
2018-08-16 23:32:30 [DEBUG   ] summary = ERROR
2018-08-16 23:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1195  13 58346 84750161 A  ERRORERROR'
2018-08-16 23:32:30 [DEBUG   ] Got command RPT from MCS: ref #1196
2018-08-16 23:32:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1196  77 58346 84750353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:32:30 [DEBUG   ] Got command RPT from MCS: ref #1197
2018-08-16 23:32:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1197  12 58346 84750557 A  ERRORB˜™š'
2018-08-16 23:32:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:32:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:33:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:33:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:33:21 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-08-16 23:33:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:33:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:34:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:34:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:34:21 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-08-16 23:34:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:34:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:35:03 [DEBUG   ] Got command RPT from MCS: ref #1203
2018-08-16 23:35:03 [DEBUG   ] summary = ERROR
2018-08-16 23:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1203  13 58346 84903513 A  ERRORERROR'
2018-08-16 23:35:03 [DEBUG   ] Got command RPT from MCS: ref #1204
2018-08-16 23:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1204  77 58346 84903514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:35:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-16 23:35:21 [DEBUG   ] Finished updating board flags in 1.665 seconds
2018-08-16 23:35:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:35:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:36:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:36:21 [DEBUG   ] Finished updating board flags in 1.494 seconds
2018-08-16 23:36:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:36:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:37:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:37:21 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-08-16 23:37:29 [DEBUG   ] Got command RPT from MCS: ref #1224
2018-08-16 23:37:29 [DEBUG   ] summary = ERROR
2018-08-16 23:37:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1224  13 58346 85049837 A  ERRORERROR'
2018-08-16 23:37:30 [DEBUG   ] Got command RPT from MCS: ref #1225
2018-08-16 23:37:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1225  77 58346 85050041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:37:30 [DEBUG   ] Got command RPT from MCS: ref #1226
2018-08-16 23:37:30 [DEBUG   ] summary = ERROR
2018-08-16 23:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1226  13 58346 85050245 A  ERRORERROR'
2018-08-16 23:37:30 [DEBUG   ] Got command RPT from MCS: ref #1227
2018-08-16 23:37:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1227  77 58346 85050437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:37:30 [DEBUG   ] Got command RPT from MCS: ref #1228
2018-08-16 23:37:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1228  12 58346 85050641 A  ERRORB˜™š'
2018-08-16 23:37:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:37:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:38:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:38:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:38:21 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-08-16 23:38:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:38:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:39:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:39:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:39:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:39:21 [DEBUG   ] Finished updating board flags in 1.526 seconds
2018-08-16 23:39:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:39:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:40:03 [DEBUG   ] Got command RPT from MCS: ref #1233
2018-08-16 23:40:03 [DEBUG   ] summary = ERROR
2018-08-16 23:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1233  13 58346 85203513 A  ERRORERROR'
2018-08-16 23:40:03 [DEBUG   ] Got command RPT from MCS: ref #1234
2018-08-16 23:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1234  77 58346 85203514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:40:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:40:22 [DEBUG   ] Finished updating board flags in 2.190 seconds
2018-08-16 23:40:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:40:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:41:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:41:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:41:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:41:22 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-08-16 23:41:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:41:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:42:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:42:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:42:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:42:22 [DEBUG   ] Finished updating board flags in 1.897 seconds
2018-08-16 23:42:29 [DEBUG   ] Got command RPT from MCS: ref #1256
2018-08-16 23:42:29 [DEBUG   ] summary = ERROR
2018-08-16 23:42:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1256  13 58346 85349925 A  ERRORERROR'
2018-08-16 23:42:30 [DEBUG   ] Got command RPT from MCS: ref #1257
2018-08-16 23:42:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1257  77 58346 85350117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:42:30 [DEBUG   ] Got command RPT from MCS: ref #1258
2018-08-16 23:42:30 [DEBUG   ] summary = ERROR
2018-08-16 23:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1258  13 58346 85350321 A  ERRORERROR'
2018-08-16 23:42:30 [DEBUG   ] Got command RPT from MCS: ref #1259
2018-08-16 23:42:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1259  77 58346 85350525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:42:30 [DEBUG   ] Got command RPT from MCS: ref #1260
2018-08-16 23:42:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1260  12 58346 85350729 A  ERRORB˜™š'
2018-08-16 23:42:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:42:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:43:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:43:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:43:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:43:22 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-08-16 23:43:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:43:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:44:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:44:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 23:44:22 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-08-16 23:44:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:44:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:45:03 [DEBUG   ] Got command RPT from MCS: ref #1270
2018-08-16 23:45:03 [DEBUG   ] summary = ERROR
2018-08-16 23:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1270  13 58346 85503517 A  ERRORERROR'
2018-08-16 23:45:03 [DEBUG   ] Got command RPT from MCS: ref #1271
2018-08-16 23:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1271  77 58346 85503518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:45:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:45:22 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-08-16 23:45:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:45:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:46:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:46:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:46:22 [DEBUG   ] Finished updating board flags in 1.636 seconds
2018-08-16 23:46:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:46:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:47:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:47:22 [DEBUG   ] Finished updating board flags in 1.637 seconds
2018-08-16 23:47:30 [DEBUG   ] Got command RPT from MCS: ref #1291
2018-08-16 23:47:30 [DEBUG   ] summary = ERROR
2018-08-16 23:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1291  13 58346 85650009 A  ERRORERROR'
2018-08-16 23:47:30 [DEBUG   ] Got command RPT from MCS: ref #1292
2018-08-16 23:47:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1292  77 58346 85650213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:47:30 [DEBUG   ] Got command RPT from MCS: ref #1293
2018-08-16 23:47:30 [DEBUG   ] summary = ERROR
2018-08-16 23:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1293  13 58346 85650405 A  ERRORERROR'
2018-08-16 23:47:30 [DEBUG   ] Got command RPT from MCS: ref #1294
2018-08-16 23:47:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1294  77 58346 85650609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:47:30 [DEBUG   ] Got command RPT from MCS: ref #1295
2018-08-16 23:47:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1295  12 58346 85650813 A  ERRORB˜™š'
2018-08-16 23:47:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:47:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:48:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:48:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 23:48:22 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-08-16 23:48:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:48:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:49:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:49:22 [DEBUG   ] Finished updating board flags in 1.533 seconds
2018-08-16 23:49:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-16 23:49:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:50:03 [DEBUG   ] Got command RPT from MCS: ref #1296
2018-08-16 23:50:03 [DEBUG   ] summary = ERROR
2018-08-16 23:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1296  13 58346 85803513 A  ERRORERROR'
2018-08-16 23:50:03 [DEBUG   ] Got command RPT from MCS: ref #1297
2018-08-16 23:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1297  77 58346 85803514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:50:15 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-16 23:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:50:22 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-08-16 23:50:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-16 23:50:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 23:51:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:51:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 23:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:51:23 [DEBUG   ] Finished updating board flags in 2.159 seconds
2018-08-16 23:51:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-16 23:51:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-16 23:52:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-16 23:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:52:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:52:23 [DEBUG   ] Finished updating board flags in 1.937 seconds
2018-08-16 23:52:30 [DEBUG   ] Got command RPT from MCS: ref #1319
2018-08-16 23:52:30 [DEBUG   ] summary = ERROR
2018-08-16 23:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1319  13 58346 85950089 A  ERRORERROR'
2018-08-16 23:52:30 [DEBUG   ] Got command RPT from MCS: ref #1320
2018-08-16 23:52:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1320  77 58346 85950293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:52:30 [DEBUG   ] Got command RPT from MCS: ref #1321
2018-08-16 23:52:30 [DEBUG   ] summary = ERROR
2018-08-16 23:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1321  13 58346 85950497 A  ERRORERROR'
2018-08-16 23:52:30 [DEBUG   ] Got command RPT from MCS: ref #1322
2018-08-16 23:52:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1322  77 58346 85950689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:52:30 [DEBUG   ] Got command RPT from MCS: ref #1323
2018-08-16 23:52:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:52:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1323  12 58346 85950893 A  ERRORB˜™š'
2018-08-16 23:52:35 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-16 23:52:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 23:53:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 23:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:53:23 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-08-16 23:53:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 23:53:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 23:54:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 23:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:54:23 [DEBUG   ] Finished updating board flags in 1.856 seconds
2018-08-16 23:54:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-16 23:54:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 23:55:03 [DEBUG   ] Got command RPT from MCS: ref #1333
2018-08-16 23:55:03 [DEBUG   ] summary = ERROR
2018-08-16 23:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1333  13 58346 86103521 A  ERRORERROR'
2018-08-16 23:55:03 [DEBUG   ] Got command RPT from MCS: ref #1334
2018-08-16 23:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1334  77 58346 86103522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:55:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 23:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:55:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:55:23 [DEBUG   ] Finished updating board flags in 1.837 seconds
2018-08-16 23:55:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 23:55:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 23:56:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 23:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:56:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-16 23:56:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-16 23:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:56:23 [DEBUG   ] Finished updating board flags in 1.707 seconds
2018-08-16 23:56:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-16 23:56:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-16 23:57:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-16 23:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:57:23 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-08-16 23:57:30 [DEBUG   ] Got command RPT from MCS: ref #1354
2018-08-16 23:57:30 [DEBUG   ] summary = ERROR
2018-08-16 23:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1354  13 58346 86250173 A  ERRORERROR'
2018-08-16 23:57:30 [DEBUG   ] Got command RPT from MCS: ref #1355
2018-08-16 23:57:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1355  77 58346 86250377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:57:30 [DEBUG   ] Got command RPT from MCS: ref #1356
2018-08-16 23:57:30 [DEBUG   ] summary = ERROR
2018-08-16 23:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1356  13 58346 86250581 A  ERRORERROR'
2018-08-16 23:57:30 [DEBUG   ] Got command RPT from MCS: ref #1357
2018-08-16 23:57:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-16 23:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1357  77 58346 86250785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-16 23:57:30 [DEBUG   ] Got command RPT from MCS: ref #1358
2018-08-16 23:57:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-16 23:57:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1358  12 58346 86250977 A  ERRORB˜™š'
2018-08-16 23:57:35 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-08-16 23:57:55 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 23:58:15 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-16 23:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:58:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-16 23:58:23 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-08-16 23:58:36 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-16 23:58:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-16 23:59:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-16 23:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-16 23:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-16 23:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-16 23:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-16 23:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-16 23:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-16 23:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-16 23:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-16 23:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-16 23:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-16 23:59:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-16 23:59:23 [DEBUG   ] Finished updating board flags in 1.476 seconds
2018-08-16 23:59:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-16 23:59:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 00:00:03 [DEBUG   ] Got command RPT from MCS: ref #1363
2018-08-17 00:00:03 [DEBUG   ] summary = ERROR
2018-08-17 00:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1363  13 58347     3522 A  ERRORERROR'
2018-08-17 00:00:03 [DEBUG   ] Got command RPT from MCS: ref #1364
2018-08-17 00:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1364  77 58347     3522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:00:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 00:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:00:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 00:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:00:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 00:00:23 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-08-17 00:00:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 00:00:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:01:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 00:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:01:23 [DEBUG   ] Finished updating board flags in 1.479 seconds
2018-08-17 00:01:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:01:56 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-17 00:02:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 00:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:02:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 00:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:02:24 [DEBUG   ] Finished updating board flags in 2.186 seconds
2018-08-17 00:02:30 [DEBUG   ] Got command RPT from MCS: ref #1386
2018-08-17 00:02:30 [DEBUG   ] summary = ERROR
2018-08-17 00:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1386  13 58347   150261 A  ERRORERROR'
2018-08-17 00:02:30 [DEBUG   ] Got command RPT from MCS: ref #1387
2018-08-17 00:02:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1387  77 58347   150465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:02:30 [DEBUG   ] Got command RPT from MCS: ref #1388
2018-08-17 00:02:30 [DEBUG   ] summary = ERROR
2018-08-17 00:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1388  13 58347   150669 A  ERRORERROR'
2018-08-17 00:02:30 [DEBUG   ] Got command RPT from MCS: ref #1389
2018-08-17 00:02:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:02:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1389  77 58347   150861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:02:31 [DEBUG   ] Got command RPT from MCS: ref #1390
2018-08-17 00:02:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1390  12 58347   151065 A  ERRORB˜™š'
2018-08-17 00:02:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 00:02:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 00:03:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 00:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:03:24 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-08-17 00:03:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 00:03:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:04:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:04:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 00:04:24 [DEBUG   ] Finished updating board flags in 1.931 seconds
2018-08-17 00:04:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:04:56 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2018-08-17 00:05:03 [DEBUG   ] Got command RPT from MCS: ref #1396
2018-08-17 00:05:03 [DEBUG   ] summary = ERROR
2018-08-17 00:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1396  13 58347   303522 A  ERRORERROR'
2018-08-17 00:05:03 [DEBUG   ] Got command RPT from MCS: ref #1397
2018-08-17 00:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1397  77 58347   303522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:05:16 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-08-17 00:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:05:24 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-08-17 00:05:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 00:05:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 00:06:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 00:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:06:24 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-17 00:06:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 00:06:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:07:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:07:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 00:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:07:24 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-17 00:07:30 [DEBUG   ] Got command RPT from MCS: ref #1417
2018-08-17 00:07:30 [DEBUG   ] summary = ERROR
2018-08-17 00:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1417  13 58347   450353 A  ERRORERROR'
2018-08-17 00:07:30 [DEBUG   ] Got command RPT from MCS: ref #1418
2018-08-17 00:07:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1418  77 58347   450545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:07:30 [DEBUG   ] Got command RPT from MCS: ref #1419
2018-08-17 00:07:30 [DEBUG   ] summary = ERROR
2018-08-17 00:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1419  13 58347   450749 A  ERRORERROR'
2018-08-17 00:07:30 [DEBUG   ] Got command RPT from MCS: ref #1420
2018-08-17 00:07:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:07:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1420  77 58347   450953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:07:31 [DEBUG   ] Got command RPT from MCS: ref #1421
2018-08-17 00:07:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1421  12 58347   451157 A  ERRORB˜™š'
2018-08-17 00:07:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:07:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 00:08:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:08:24 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-08-17 00:08:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:08:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:09:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 00:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:09:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 00:09:24 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-08-17 00:09:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:09:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:10:03 [DEBUG   ] Got command RPT from MCS: ref #1426
2018-08-17 00:10:03 [DEBUG   ] summary = ERROR
2018-08-17 00:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1426  13 58347   603525 A  ERRORERROR'
2018-08-17 00:10:03 [DEBUG   ] Got command RPT from MCS: ref #1427
2018-08-17 00:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1427  77 58347   603526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:10:17 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-17 00:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:10:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-17 00:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:10:24 [DEBUG   ] Finished updating board flags in 1.504 seconds
2018-08-17 00:10:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 00:10:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 00:11:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:11:23 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 00:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:11:24 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-08-17 00:11:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:11:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:12:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:12:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 00:12:25 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-08-17 00:12:30 [DEBUG   ] Got command RPT from MCS: ref #1449
2018-08-17 00:12:30 [DEBUG   ] summary = ERROR
2018-08-17 00:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1449  13 58347   750429 A  ERRORERROR'
2018-08-17 00:12:30 [DEBUG   ] Got command RPT from MCS: ref #1450
2018-08-17 00:12:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1450  77 58347   750633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:12:30 [DEBUG   ] Got command RPT from MCS: ref #1451
2018-08-17 00:12:30 [DEBUG   ] summary = ERROR
2018-08-17 00:12:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1451  13 58347   750837 A  ERRORERROR'
2018-08-17 00:12:31 [DEBUG   ] Got command RPT from MCS: ref #1452
2018-08-17 00:12:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1452  77 58347   751041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:12:31 [DEBUG   ] Got command RPT from MCS: ref #1453
2018-08-17 00:12:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1453  12 58347   751233 A  ERRORB˜™š'
2018-08-17 00:12:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:12:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:13:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:13:25 [DEBUG   ] Finished updating board flags in 2.082 seconds
2018-08-17 00:13:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:13:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 00:14:17 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 00:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:14:25 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-08-17 00:14:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 00:14:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 00:15:03 [DEBUG   ] Got command RPT from MCS: ref #1463
2018-08-17 00:15:03 [DEBUG   ] summary = ERROR
2018-08-17 00:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1463  13 58347   903521 A  ERRORERROR'
2018-08-17 00:15:03 [DEBUG   ] Got command RPT from MCS: ref #1464
2018-08-17 00:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1464  77 58347   903522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:15:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 00:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:15:25 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-08-17 00:15:37 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 00:15:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 00:16:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 00:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:16:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 00:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:16:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 00:16:25 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-08-17 00:16:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 00:16:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:17:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 00:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:17:25 [DEBUG   ] Finished updating board flags in 1.797 seconds
2018-08-17 00:17:30 [DEBUG   ] Got command RPT from MCS: ref #1484
2018-08-17 00:17:30 [DEBUG   ] summary = ERROR
2018-08-17 00:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1484  13 58347  1050525 A  ERRORERROR'
2018-08-17 00:17:30 [DEBUG   ] Got command RPT from MCS: ref #1485
2018-08-17 00:17:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1485  77 58347  1050717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:17:30 [DEBUG   ] Got command RPT from MCS: ref #1486
2018-08-17 00:17:30 [DEBUG   ] summary = ERROR
2018-08-17 00:17:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1486  13 58347  1050921 A  ERRORERROR'
2018-08-17 00:17:31 [DEBUG   ] Got command RPT from MCS: ref #1487
2018-08-17 00:17:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1487  77 58347  1051125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:17:31 [DEBUG   ] Got command RPT from MCS: ref #1488
2018-08-17 00:17:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1488  12 58347  1051340 A  ERRORB˜™š'
2018-08-17 00:17:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 00:17:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 00:18:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 00:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:18:25 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-08-17 00:18:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 00:18:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 00:19:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:19:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 00:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:19:25 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-17 00:19:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:19:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 00:20:03 [DEBUG   ] Got command RPT from MCS: ref #1489
2018-08-17 00:20:03 [DEBUG   ] summary = ERROR
2018-08-17 00:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1489  13 58347  1203521 A  ERRORERROR'
2018-08-17 00:20:03 [DEBUG   ] Got command RPT from MCS: ref #1490
2018-08-17 00:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1490  77 58347  1203522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:20:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:20:25 [DEBUG   ] Finished updating board flags in 1.549 seconds
2018-08-17 00:20:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:20:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:21:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:21:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 00:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:21:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 00:21:25 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-08-17 00:21:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 00:21:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 00:22:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 00:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:22:26 [DEBUG   ] Finished updating board flags in 2.192 seconds
2018-08-17 00:22:30 [DEBUG   ] Got command RPT from MCS: ref #1512
2018-08-17 00:22:30 [DEBUG   ] summary = ERROR
2018-08-17 00:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1512  13 58347  1350609 A  ERRORERROR'
2018-08-17 00:22:30 [DEBUG   ] Got command RPT from MCS: ref #1513
2018-08-17 00:22:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:22:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1513  77 58347  1350801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:22:31 [DEBUG   ] Got command RPT from MCS: ref #1514
2018-08-17 00:22:31 [DEBUG   ] summary = ERROR
2018-08-17 00:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1514  13 58347  1351005 A  ERRORERROR'
2018-08-17 00:22:31 [DEBUG   ] Got command RPT from MCS: ref #1515
2018-08-17 00:22:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1515  77 58347  1351209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:22:31 [DEBUG   ] Got command RPT from MCS: ref #1516
2018-08-17 00:22:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1516  12 58347  1351413 A  ERRORB˜™š'
2018-08-17 00:22:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 00:22:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:23:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:23:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 00:23:26 [DEBUG   ] Finished updating board flags in 1.876 seconds
2018-08-17 00:23:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:23:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:24:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:24:26 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-08-17 00:24:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 00:24:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:25:03 [DEBUG   ] Got command RPT from MCS: ref #1526
2018-08-17 00:25:03 [DEBUG   ] summary = ERROR
2018-08-17 00:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1526  13 58347  1503529 A  ERRORERROR'
2018-08-17 00:25:03 [DEBUG   ] Got command RPT from MCS: ref #1527
2018-08-17 00:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1527  77 58347  1503530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:25:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:25:26 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-08-17 00:25:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:25:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:26:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:26:26 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-08-17 00:26:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:26:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:27:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:27:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 00:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:27:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 00:27:26 [DEBUG   ] Finished updating board flags in 1.697 seconds
2018-08-17 00:27:30 [DEBUG   ] Got command RPT from MCS: ref #1547
2018-08-17 00:27:30 [DEBUG   ] summary = ERROR
2018-08-17 00:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1547  13 58347  1650693 A  ERRORERROR'
2018-08-17 00:27:30 [DEBUG   ] Got command RPT from MCS: ref #1548
2018-08-17 00:27:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:27:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1548  77 58347  1650885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:27:31 [DEBUG   ] Got command RPT from MCS: ref #1549
2018-08-17 00:27:31 [DEBUG   ] summary = ERROR
2018-08-17 00:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1549  13 58347  1651089 A  ERRORERROR'
2018-08-17 00:27:31 [DEBUG   ] Got command RPT from MCS: ref #1550
2018-08-17 00:27:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1550  77 58347  1651293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:27:31 [DEBUG   ] Got command RPT from MCS: ref #1551
2018-08-17 00:27:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1551  12 58347  1651497 A  ERRORB˜™š'
2018-08-17 00:27:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:27:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:28:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:28:26 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-08-17 00:28:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 00:28:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:29:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:29:26 [DEBUG   ] Finished updating board flags in 1.488 seconds
2018-08-17 00:29:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:29:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:30:03 [DEBUG   ] Got command RPT from MCS: ref #1556
2018-08-17 00:30:03 [DEBUG   ] summary = ERROR
2018-08-17 00:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1556  13 58347  1803522 A  ERRORERROR'
2018-08-17 00:30:03 [DEBUG   ] Got command RPT from MCS: ref #1557
2018-08-17 00:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1557  77 58347  1803522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:30:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:30:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 00:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:30:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 00:30:26 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-08-17 00:30:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:30:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:31:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 00:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:31:26 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-08-17 00:31:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:31:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:32:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:32:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 00:32:27 [DEBUG   ] Finished updating board flags in 2.171 seconds
2018-08-17 00:32:30 [DEBUG   ] Got command RPT from MCS: ref #1579
2018-08-17 00:32:30 [DEBUG   ] summary = ERROR
2018-08-17 00:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1579  13 58347  1950777 A  ERRORERROR'
2018-08-17 00:32:30 [DEBUG   ] Got command RPT from MCS: ref #1580
2018-08-17 00:32:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1580  77 58347  1950969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:32:31 [DEBUG   ] Got command RPT from MCS: ref #1581
2018-08-17 00:32:31 [DEBUG   ] summary = ERROR
2018-08-17 00:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1581  13 58347  1951173 A  ERRORERROR'
2018-08-17 00:32:31 [DEBUG   ] Got command RPT from MCS: ref #1582
2018-08-17 00:32:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1582  77 58347  1951377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:32:31 [DEBUG   ] Got command RPT from MCS: ref #1583
2018-08-17 00:32:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1583  12 58347  1951569 A  ERRORB˜™š'
2018-08-17 00:32:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:32:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 00:33:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:33:27 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-08-17 00:33:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:33:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 00:34:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:34:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 00:34:27 [DEBUG   ] Finished updating board flags in 1.927 seconds
2018-08-17 00:34:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:34:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:35:03 [DEBUG   ] Got command RPT from MCS: ref #1589
2018-08-17 00:35:03 [DEBUG   ] summary = ERROR
2018-08-17 00:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1589  13 58347  2103529 A  ERRORERROR'
2018-08-17 00:35:03 [DEBUG   ] Got command RPT from MCS: ref #1590
2018-08-17 00:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1590  77 58347  2103530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:35:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 00:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:35:27 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-17 00:35:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:35:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 00:36:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:36:27 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-17 00:36:38 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-08-17 00:36:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 00:37:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 00:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:37:27 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-08-17 00:37:30 [DEBUG   ] Got command RPT from MCS: ref #1610
2018-08-17 00:37:30 [DEBUG   ] summary = ERROR
2018-08-17 00:37:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1610  13 58347  2250857 A  ERRORERROR'
2018-08-17 00:37:31 [DEBUG   ] Got command RPT from MCS: ref #1611
2018-08-17 00:37:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1611  77 58347  2251061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:37:31 [DEBUG   ] Got command RPT from MCS: ref #1612
2018-08-17 00:37:31 [DEBUG   ] summary = ERROR
2018-08-17 00:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1612  13 58347  2251253 A  ERRORERROR'
2018-08-17 00:37:31 [DEBUG   ] Got command RPT from MCS: ref #1613
2018-08-17 00:37:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1613  77 58347  2251457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:37:31 [DEBUG   ] Got command RPT from MCS: ref #1614
2018-08-17 00:37:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1614  12 58347  2251661 A  ERRORB˜™š'
2018-08-17 00:37:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 00:37:58 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 00:38:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 00:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:38:27 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-08-17 00:38:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 00:38:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:39:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:39:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 00:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:39:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 00:39:27 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-08-17 00:39:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 00:39:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 00:40:03 [DEBUG   ] Got command RPT from MCS: ref #1619
2018-08-17 00:40:03 [DEBUG   ] summary = ERROR
2018-08-17 00:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1619  13 58347  2403533 A  ERRORERROR'
2018-08-17 00:40:03 [DEBUG   ] Got command RPT from MCS: ref #1620
2018-08-17 00:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1620  77 58347  2403534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:40:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:40:27 [DEBUG   ] Finished updating board flags in 1.543 seconds
2018-08-17 00:40:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:40:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 00:41:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:41:28 [DEBUG   ] Finished updating board flags in 2.189 seconds
2018-08-17 00:41:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:41:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 00:42:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 00:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:42:28 [DEBUG   ] Finished updating board flags in 1.920 seconds
2018-08-17 00:42:30 [DEBUG   ] Got command RPT from MCS: ref #1642
2018-08-17 00:42:30 [DEBUG   ] summary = ERROR
2018-08-17 00:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1642  13 58347  2550933 A  ERRORERROR'
2018-08-17 00:42:31 [DEBUG   ] Got command RPT from MCS: ref #1643
2018-08-17 00:42:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1643  77 58347  2551137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:42:31 [DEBUG   ] Got command RPT from MCS: ref #1644
2018-08-17 00:42:31 [DEBUG   ] summary = ERROR
2018-08-17 00:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1644  13 58347  2551341 A  ERRORERROR'
2018-08-17 00:42:31 [DEBUG   ] Got command RPT from MCS: ref #1645
2018-08-17 00:42:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1645  77 58347  2551545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:42:31 [DEBUG   ] Got command RPT from MCS: ref #1646
2018-08-17 00:42:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1646  12 58347  2551737 A  ERRORB—™š'
2018-08-17 00:42:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 00:42:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:43:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 00:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:43:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 00:43:28 [DEBUG   ] Finished updating board flags in 1.843 seconds
2018-08-17 00:43:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 00:43:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 00:44:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:44:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 00:44:28 [DEBUG   ] Finished updating board flags in 1.758 seconds
2018-08-17 00:44:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:44:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 00:45:03 [DEBUG   ] Got command RPT from MCS: ref #1656
2018-08-17 00:45:03 [DEBUG   ] summary = ERROR
2018-08-17 00:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1656  13 58347  2703533 A  ERRORERROR'
2018-08-17 00:45:03 [DEBUG   ] Got command RPT from MCS: ref #1657
2018-08-17 00:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1657  77 58347  2703534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:45:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:45:28 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-08-17 00:45:39 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-17 00:45:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:46:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:46:28 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-08-17 00:46:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:46:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:47:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 00:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:47:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 00:47:28 [DEBUG   ] Finished updating board flags in 1.483 seconds
2018-08-17 00:47:31 [DEBUG   ] Got command RPT from MCS: ref #1677
2018-08-17 00:47:31 [DEBUG   ] summary = ERROR
2018-08-17 00:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1677  13 58347  2851025 A  ERRORERROR'
2018-08-17 00:47:31 [DEBUG   ] Got command RPT from MCS: ref #1678
2018-08-17 00:47:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1678  77 58347  2851217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:47:31 [DEBUG   ] Got command RPT from MCS: ref #1679
2018-08-17 00:47:31 [DEBUG   ] summary = ERROR
2018-08-17 00:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1679  13 58347  2851421 A  ERRORERROR'
2018-08-17 00:47:31 [DEBUG   ] Got command RPT from MCS: ref #1680
2018-08-17 00:47:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1680  77 58347  2851625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:47:31 [DEBUG   ] Got command RPT from MCS: ref #1681
2018-08-17 00:47:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1681  12 58347  2851829 A  ERRORB—™š'
2018-08-17 00:47:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 00:47:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:48:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:48:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:48:28 [DEBUG   ] Finished updating board flags in 1.553 seconds
2018-08-17 00:48:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 00:48:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 00:49:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:49:29 [DEBUG   ] Finished updating board flags in 2.263 seconds
2018-08-17 00:49:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:49:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:50:03 [DEBUG   ] Got command RPT from MCS: ref #1682
2018-08-17 00:50:03 [DEBUG   ] summary = ERROR
2018-08-17 00:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1682  13 58347  3003525 A  ERRORERROR'
2018-08-17 00:50:03 [DEBUG   ] Got command RPT from MCS: ref #1683
2018-08-17 00:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1683  77 58347  3003526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:50:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 00:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:50:29 [DEBUG   ] Finished updating board flags in 2.240 seconds
2018-08-17 00:50:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:50:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 00:51:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 00:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:51:29 [DEBUG   ] Finished updating board flags in 2.073 seconds
2018-08-17 00:51:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 00:51:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 00:52:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 00:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:52:29 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-08-17 00:52:31 [DEBUG   ] Got command RPT from MCS: ref #1705
2018-08-17 00:52:31 [DEBUG   ] summary = ERROR
2018-08-17 00:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1705  13 58347  3151101 A  ERRORERROR'
2018-08-17 00:52:31 [DEBUG   ] Got command RPT from MCS: ref #1706
2018-08-17 00:52:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1706  77 58347  3151305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:52:31 [DEBUG   ] Got command RPT from MCS: ref #1707
2018-08-17 00:52:31 [DEBUG   ] summary = ERROR
2018-08-17 00:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1707  13 58347  3151509 A  ERRORERROR'
2018-08-17 00:52:31 [DEBUG   ] Got command RPT from MCS: ref #1708
2018-08-17 00:52:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1708  77 58347  3151701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:52:31 [DEBUG   ] Got command RPT from MCS: ref #1709
2018-08-17 00:52:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:52:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1709  12 58347  3151905 A  ERRORB˜™š'
2018-08-17 00:52:39 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-17 00:52:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 00:53:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 00:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:53:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 00:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:53:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 00:53:29 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-08-17 00:53:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 00:53:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 00:54:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 00:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:54:29 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-08-17 00:54:39 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 00:54:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 00:55:03 [DEBUG   ] Got command RPT from MCS: ref #1719
2018-08-17 00:55:03 [DEBUG   ] summary = ERROR
2018-08-17 00:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1719  13 58347  3303525 A  ERRORERROR'
2018-08-17 00:55:03 [DEBUG   ] Got command RPT from MCS: ref #1720
2018-08-17 00:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1720  77 58347  3303526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:55:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:55:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-17 00:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:55:29 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-08-17 00:55:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 00:55:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 00:56:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 00:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:56:29 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-08-17 00:56:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 00:56:59 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 00:57:20 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 00:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:57:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 00:57:29 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-08-17 00:57:31 [DEBUG   ] Got command RPT from MCS: ref #1740
2018-08-17 00:57:31 [DEBUG   ] summary = ERROR
2018-08-17 00:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1740  13 58347  3451185 A  ERRORERROR'
2018-08-17 00:57:31 [DEBUG   ] Got command RPT from MCS: ref #1741
2018-08-17 00:57:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1741  77 58347  3451389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:57:31 [DEBUG   ] Got command RPT from MCS: ref #1742
2018-08-17 00:57:31 [DEBUG   ] summary = ERROR
2018-08-17 00:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1742  13 58347  3451593 A  ERRORERROR'
2018-08-17 00:57:31 [DEBUG   ] Got command RPT from MCS: ref #1743
2018-08-17 00:57:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 00:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1743  77 58347  3451797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 00:57:31 [DEBUG   ] Got command RPT from MCS: ref #1744
2018-08-17 00:57:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 00:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1744  12 58347  3451989 A  ERRORB—™š'
2018-08-17 00:57:40 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-17 00:58:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 00:58:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 00:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:58:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:58:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-08-17 00:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:58:29 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-08-17 00:58:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 00:59:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 00:59:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 00:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 00:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 00:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 00:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 00:59:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 00:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 00:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 00:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 00:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 00:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 00:59:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 00:59:29 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-08-17 00:59:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 01:00:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 01:00:03 [DEBUG   ] Got command RPT from MCS: ref #1749
2018-08-17 01:00:03 [DEBUG   ] summary = ERROR
2018-08-17 01:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1749  13 58347  3603529 A  ERRORERROR'
2018-08-17 01:00:03 [DEBUG   ] Got command RPT from MCS: ref #1750
2018-08-17 01:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1750  77 58347  3603530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:00:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 01:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:00:30 [DEBUG   ] Finished updating board flags in 2.259 seconds
2018-08-17 01:00:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 01:01:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 01:01:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 01:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:01:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:01:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 01:01:29 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-08-17 01:01:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 01:02:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 01:02:21 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 01:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:02:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 01:02:30 [DEBUG   ] Finished updating board flags in 2.083 seconds
2018-08-17 01:02:31 [DEBUG   ] Got command RPT from MCS: ref #1772
2018-08-17 01:02:31 [DEBUG   ] summary = ERROR
2018-08-17 01:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1772  13 58347  3751269 A  ERRORERROR'
2018-08-17 01:02:31 [DEBUG   ] Got command RPT from MCS: ref #1773
2018-08-17 01:02:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1773  77 58347  3751473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:02:31 [DEBUG   ] Got command RPT from MCS: ref #1774
2018-08-17 01:02:31 [DEBUG   ] summary = ERROR
2018-08-17 01:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1774  13 58347  3751677 A  ERRORERROR'
2018-08-17 01:02:31 [DEBUG   ] Got command RPT from MCS: ref #1775
2018-08-17 01:02:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:02:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1775  77 58347  3751881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:02:32 [DEBUG   ] Got command RPT from MCS: ref #1776
2018-08-17 01:02:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1776  12 58347  3752073 A  ERRORB—™š'
2018-08-17 01:02:41 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 01:03:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 01:03:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 01:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:03:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 01:03:30 [DEBUG   ] Finished updating board flags in 1.955 seconds
2018-08-17 01:03:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 01:04:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 01:04:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 01:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:04:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-08-17 01:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:04:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 01:04:30 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-08-17 01:04:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 01:05:01 [DEBUG   ] Finished updating ant stats in 0.808 seconds
2018-08-17 01:05:03 [DEBUG   ] Got command RPT from MCS: ref #1782
2018-08-17 01:05:03 [DEBUG   ] summary = ERROR
2018-08-17 01:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1782  13 58347  3903533 A  ERRORERROR'
2018-08-17 01:05:03 [DEBUG   ] Got command RPT from MCS: ref #1783
2018-08-17 01:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1783  77 58347  3903534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:05:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 01:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:05:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 01:05:30 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-08-17 01:05:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 01:06:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 01:06:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 01:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:06:30 [DEBUG   ] Finished updating board flags in 1.683 seconds
2018-08-17 01:06:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 01:07:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 01:07:21 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-17 01:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:07:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:07:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 01:07:30 [DEBUG   ] Finished updating board flags in 1.523 seconds
2018-08-17 01:07:31 [DEBUG   ] Got command RPT from MCS: ref #1803
2018-08-17 01:07:31 [DEBUG   ] summary = ERROR
2018-08-17 01:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1803  13 58347  4051365 A  ERRORERROR'
2018-08-17 01:07:31 [DEBUG   ] Got command RPT from MCS: ref #1804
2018-08-17 01:07:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1804  77 58347  4051557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:07:31 [DEBUG   ] Got command RPT from MCS: ref #1805
2018-08-17 01:07:31 [DEBUG   ] summary = ERROR
2018-08-17 01:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1805  13 58347  4051761 A  ERRORERROR'
2018-08-17 01:07:31 [DEBUG   ] Got command RPT from MCS: ref #1806
2018-08-17 01:07:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:07:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1806  77 58347  4051965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:07:32 [DEBUG   ] Got command RPT from MCS: ref #1807
2018-08-17 01:07:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1807  12 58347  4052157 A  ERRORB—™š'
2018-08-17 01:07:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 01:08:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 01:08:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 01:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:08:30 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-17 01:08:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 01:09:02 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-08-17 01:09:21 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-17 01:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:09:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:09:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 01:09:30 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-08-17 01:09:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 01:10:01 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 01:10:03 [DEBUG   ] Got command RPT from MCS: ref #1812
2018-08-17 01:10:03 [DEBUG   ] summary = ERROR
2018-08-17 01:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1812  13 58347  4203537 A  ERRORERROR'
2018-08-17 01:10:03 [DEBUG   ] Got command RPT from MCS: ref #1813
2018-08-17 01:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1813  77 58347  4203538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:10:22 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 01:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:10:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:10:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 01:10:30 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-08-17 01:10:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 01:11:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 01:11:22 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-17 01:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:11:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 01:11:31 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-08-17 01:11:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 01:12:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 01:12:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 01:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:12:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:12:31 [DEBUG   ] Got command RPT from MCS: ref #1835
2018-08-17 01:12:31 [DEBUG   ] summary = ERROR
2018-08-17 01:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1835  13 58347  4351441 A  ERRORERROR'
2018-08-17 01:12:31 [DEBUG   ] Got command RPT from MCS: ref #1836
2018-08-17 01:12:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1836  77 58347  4351646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:12:31 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-08-17 01:12:31 [DEBUG   ] Got command RPT from MCS: ref #1837
2018-08-17 01:12:31 [DEBUG   ] summary = ERROR
2018-08-17 01:12:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1837  13 58347  4351849 A  ERRORERROR'
2018-08-17 01:12:32 [DEBUG   ] Got command RPT from MCS: ref #1838
2018-08-17 01:12:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1838  77 58347  4352041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:12:32 [DEBUG   ] Got command RPT from MCS: ref #1839
2018-08-17 01:12:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1839  12 58347  4352245 A  ERRORB˜™š'
2018-08-17 01:12:42 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 01:13:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 01:13:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 01:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:13:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:13:31 [DEBUG   ] Finished updating board flags in 1.912 seconds
2018-08-17 01:13:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 01:14:02 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-17 01:14:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 01:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:14:31 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-08-17 01:14:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 01:15:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 01:15:03 [DEBUG   ] Got command RPT from MCS: ref #1849
2018-08-17 01:15:03 [DEBUG   ] summary = ERROR
2018-08-17 01:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1849  13 58347  4503529 A  ERRORERROR'
2018-08-17 01:15:03 [DEBUG   ] Got command RPT from MCS: ref #1850
2018-08-17 01:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1850  77 58347  4503530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:15:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 01:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:15:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:15:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 01:15:31 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-08-17 01:15:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 01:16:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 01:16:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 01:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:16:31 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-08-17 01:16:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 01:17:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 01:17:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 01:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:17:31 [DEBUG   ] Got command RPT from MCS: ref #1870
2018-08-17 01:17:31 [DEBUG   ] summary = ERROR
2018-08-17 01:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1870  13 58347  4651533 A  ERRORERROR'
2018-08-17 01:17:31 [DEBUG   ] Got command RPT from MCS: ref #1871
2018-08-17 01:17:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1871  77 58347  4651726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:17:31 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-08-17 01:17:31 [DEBUG   ] Got command RPT from MCS: ref #1872
2018-08-17 01:17:31 [DEBUG   ] summary = ERROR
2018-08-17 01:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1872  13 58347  4651929 A  ERRORERROR'
2018-08-17 01:17:32 [DEBUG   ] Got command RPT from MCS: ref #1873
2018-08-17 01:17:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1873  77 58347  4652133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:17:32 [DEBUG   ] Got command RPT from MCS: ref #1874
2018-08-17 01:17:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1874  12 58347  4652337 A  ERRORB˜™š'
2018-08-17 01:17:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 01:18:03 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-17 01:18:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 01:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:18:31 [DEBUG   ] Finished updating board flags in 1.329 seconds
2018-08-17 01:18:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 01:19:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 01:19:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 01:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:19:32 [DEBUG   ] Finished updating board flags in 2.079 seconds
2018-08-17 01:19:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 01:20:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 01:20:03 [DEBUG   ] Got command RPT from MCS: ref #1875
2018-08-17 01:20:03 [DEBUG   ] summary = ERROR
2018-08-17 01:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1875  13 58347  4803533 A  ERRORERROR'
2018-08-17 01:20:03 [DEBUG   ] Got command RPT from MCS: ref #1876
2018-08-17 01:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1876  77 58347  4803534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:20:24 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-17 01:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:20:32 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-08-17 01:20:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 01:21:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 01:21:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 01:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:21:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:21:32 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-08-17 01:21:44 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 01:22:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 01:22:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 01:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:22:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:22:31 [DEBUG   ] Got command RPT from MCS: ref #1898
2018-08-17 01:22:31 [DEBUG   ] summary = ERROR
2018-08-17 01:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1898  13 58347  4951622 A  ERRORERROR'
2018-08-17 01:22:31 [DEBUG   ] Got command RPT from MCS: ref #1899
2018-08-17 01:22:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:22:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1899  77 58347  4951813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:22:32 [DEBUG   ] Got command RPT from MCS: ref #1900
2018-08-17 01:22:32 [DEBUG   ] summary = ERROR
2018-08-17 01:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1900  13 58347  4952017 A  ERRORERROR'
2018-08-17 01:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:22:32 [DEBUG   ] Got command RPT from MCS: ref #1901
2018-08-17 01:22:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1901  77 58347  4952225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:22:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 01:22:32 [DEBUG   ] Got command RPT from MCS: ref #1902
2018-08-17 01:22:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1902  12 58347  4952417 A  ERRORB˜™š'
2018-08-17 01:22:32 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-08-17 01:22:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 01:23:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 01:23:24 [DEBUG   ] Finished updating ant stats in 0.540 seconds
2018-08-17 01:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:23:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 01:23:32 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-08-17 01:23:45 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 01:24:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 01:24:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 01:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:24:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 01:24:32 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-08-17 01:24:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 01:25:03 [DEBUG   ] Got command RPT from MCS: ref #1912
2018-08-17 01:25:03 [DEBUG   ] summary = ERROR
2018-08-17 01:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1912  13 58347  5103533 A  ERRORERROR'
2018-08-17 01:25:03 [DEBUG   ] Got command RPT from MCS: ref #1913
2018-08-17 01:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1913  77 58347  5103534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:25:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 01:25:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 01:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:25:32 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-08-17 01:25:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 01:26:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 01:26:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 01:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:26:32 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-17 01:26:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 01:27:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 01:27:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 01:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:27:31 [DEBUG   ] Got command RPT from MCS: ref #1933
2018-08-17 01:27:31 [DEBUG   ] summary = ERROR
2018-08-17 01:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1933  13 58347  5251698 A  ERRORERROR'
2018-08-17 01:27:31 [DEBUG   ] Got command RPT from MCS: ref #1934
2018-08-17 01:27:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:27:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1934  77 58347  5251902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:27:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 01:27:32 [DEBUG   ] Got command RPT from MCS: ref #1935
2018-08-17 01:27:32 [DEBUG   ] summary = ERROR
2018-08-17 01:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1935  13 58347  5252098 A  ERRORERROR'
2018-08-17 01:27:32 [DEBUG   ] Got command RPT from MCS: ref #1936
2018-08-17 01:27:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1936  77 58347  5252301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:27:32 [DEBUG   ] Got command RPT from MCS: ref #1937
2018-08-17 01:27:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1937  12 58347  5252506 A  ERRORB˜™š'
2018-08-17 01:27:32 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-08-17 01:27:46 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 01:28:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 01:28:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 01:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:28:32 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-08-17 01:28:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 01:29:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 01:29:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 01:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:29:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 01:29:33 [DEBUG   ] Finished updating board flags in 2.070 seconds
2018-08-17 01:29:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 01:30:03 [DEBUG   ] Got command RPT from MCS: ref #1942
2018-08-17 01:30:03 [DEBUG   ] summary = ERROR
2018-08-17 01:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1942  13 58347  5403537 A  ERRORERROR'
2018-08-17 01:30:03 [DEBUG   ] Got command RPT from MCS: ref #1943
2018-08-17 01:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1943  77 58347  5403538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:30:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 01:30:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 01:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:30:33 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-08-17 01:30:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 01:31:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 01:31:26 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 01:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-17 01:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:31:33 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-08-17 01:31:46 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-17 01:32:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 01:32:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 01:32:31 [DEBUG   ] Got command RPT from MCS: ref #1965
2018-08-17 01:32:31 [DEBUG   ] summary = ERROR
2018-08-17 01:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1965  13 58347  5551785 A  ERRORERROR'
2018-08-17 01:32:31 [DEBUG   ] Got command RPT from MCS: ref #1966
2018-08-17 01:32:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:32:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1966  77 58347  5551989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:32:32 [DEBUG   ] Got command RPT from MCS: ref #1967
2018-08-17 01:32:32 [DEBUG   ] summary = ERROR
2018-08-17 01:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1967  13 58347  5552186 A  ERRORERROR'
2018-08-17 01:32:32 [DEBUG   ] Got command RPT from MCS: ref #1968
2018-08-17 01:32:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1968  77 58347  5552389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:32:32 [DEBUG   ] Got command RPT from MCS: ref #1969
2018-08-17 01:32:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1969  12 58347  5552593 A  ERRORBŽÌÍ'
2018-08-17 01:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:32:33 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-08-17 01:32:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 01:33:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 01:33:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 01:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:33:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:33:33 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-08-17 01:33:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 01:34:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 01:34:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 01:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:34:33 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-08-17 01:34:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 01:35:03 [DEBUG   ] Got command RPT from MCS: ref #1975
2018-08-17 01:35:03 [DEBUG   ] summary = ERROR
2018-08-17 01:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1975  13 58347  5703537 A  ERRORERROR'
2018-08-17 01:35:03 [DEBUG   ] Got command RPT from MCS: ref #1976
2018-08-17 01:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1976  77 58347  5703538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:35:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 01:35:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 01:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:35:33 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-08-17 01:35:47 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-08-17 01:36:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 01:36:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 01:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:36:33 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-08-17 01:36:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 01:37:08 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 01:37:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 01:37:31 [DEBUG   ] Got command RPT from MCS: ref #1996
2018-08-17 01:37:31 [DEBUG   ] summary = ERROR
2018-08-17 01:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1996  13 58347  5851869 A  ERRORERROR'
2018-08-17 01:37:32 [DEBUG   ] Got command RPT from MCS: ref #1997
2018-08-17 01:37:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1997  77 58347  5852073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:37:32 [DEBUG   ] Got command RPT from MCS: ref #1998
2018-08-17 01:37:32 [DEBUG   ] summary = ERROR
2018-08-17 01:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1998  13 58347  5852266 A  ERRORERROR'
2018-08-17 01:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:37:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:37:32 [DEBUG   ] Got command RPT from MCS: ref #1999
2018-08-17 01:37:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     1999  77 58347  5852469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:37:32 [DEBUG   ] Got command RPT from MCS: ref #2000
2018-08-17 01:37:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2000  12 58347  5852674 A  ERRORBŽÌÍ'
2018-08-17 01:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:37:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 01:37:33 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-17 01:37:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 01:38:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 01:38:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 01:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:38:33 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-08-17 01:38:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 01:39:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 01:39:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 01:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 01:39:33 [DEBUG   ] Finished updating board flags in 1.349 seconds
2018-08-17 01:39:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 01:40:03 [DEBUG   ] Got command RPT from MCS: ref #2005
2018-08-17 01:40:03 [DEBUG   ] summary = ERROR
2018-08-17 01:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2005  13 58347  6003545 A  ERRORERROR'
2018-08-17 01:40:03 [DEBUG   ] Got command RPT from MCS: ref #2006
2018-08-17 01:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2006  77 58347  6003546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:40:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 01:40:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 01:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:40:34 [DEBUG   ] Finished updating board flags in 2.069 seconds
2018-08-17 01:40:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 01:41:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 01:41:29 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-08-17 01:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:41:34 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-08-17 01:41:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 01:42:09 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 01:42:29 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-17 01:42:31 [DEBUG   ] Got command RPT from MCS: ref #2028
2018-08-17 01:42:31 [DEBUG   ] summary = ERROR
2018-08-17 01:42:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2028  13 58347  6151957 A  ERRORERROR'
2018-08-17 01:42:32 [DEBUG   ] Got command RPT from MCS: ref #2029
2018-08-17 01:42:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2029  77 58347  6152149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:42:32 [DEBUG   ] Got command RPT from MCS: ref #2030
2018-08-17 01:42:32 [DEBUG   ] summary = ERROR
2018-08-17 01:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2030  13 58347  6152353 A  ERRORERROR'
2018-08-17 01:42:32 [DEBUG   ] Got command RPT from MCS: ref #2031
2018-08-17 01:42:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2031  77 58347  6152557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:42:32 [DEBUG   ] Got command RPT from MCS: ref #2032
2018-08-17 01:42:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2032  12 58347  6152761 A  ERRORB—™š'
2018-08-17 01:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:42:34 [DEBUG   ] Finished updating board flags in 1.842 seconds
2018-08-17 01:42:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 01:43:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 01:43:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 01:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:43:34 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-08-17 01:43:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 01:44:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 01:44:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 01:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:44:34 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-08-17 01:44:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 01:45:03 [DEBUG   ] Got command RPT from MCS: ref #2042
2018-08-17 01:45:03 [DEBUG   ] summary = ERROR
2018-08-17 01:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2042  13 58347  6303542 A  ERRORERROR'
2018-08-17 01:45:03 [DEBUG   ] Got command RPT from MCS: ref #2043
2018-08-17 01:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2043  77 58347  6303542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:45:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 01:45:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 01:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:45:34 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-08-17 01:45:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 01:46:10 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 01:46:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 01:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:46:34 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-08-17 01:46:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 01:47:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 01:47:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 01:47:32 [DEBUG   ] Got command RPT from MCS: ref #2063
2018-08-17 01:47:32 [DEBUG   ] summary = ERROR
2018-08-17 01:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2063  13 58347  6452034 A  ERRORERROR'
2018-08-17 01:47:32 [DEBUG   ] Got command RPT from MCS: ref #2064
2018-08-17 01:47:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2064  77 58347  6452237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:47:32 [DEBUG   ] Got command RPT from MCS: ref #2065
2018-08-17 01:47:32 [DEBUG   ] summary = ERROR
2018-08-17 01:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2065  13 58347  6452441 A  ERRORERROR'
2018-08-17 01:47:32 [DEBUG   ] Got command RPT from MCS: ref #2066
2018-08-17 01:47:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2066  77 58347  6452645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:47:32 [DEBUG   ] Got command RPT from MCS: ref #2067
2018-08-17 01:47:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:47:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2067  12 58347  6452838 A  ERRORB˜™š'
2018-08-17 01:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:47:33 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:47:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 01:47:34 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-08-17 01:47:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 01:48:10 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-08-17 01:48:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 01:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:48:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:48:34 [DEBUG   ] Finished updating board flags in 1.325 seconds
2018-08-17 01:48:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 01:49:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 01:49:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 01:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:49:35 [DEBUG   ] Finished updating board flags in 2.179 seconds
2018-08-17 01:49:50 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-17 01:50:03 [DEBUG   ] Got command RPT from MCS: ref #2068
2018-08-17 01:50:03 [DEBUG   ] summary = ERROR
2018-08-17 01:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2068  13 58347  6603545 A  ERRORERROR'
2018-08-17 01:50:03 [DEBUG   ] Got command RPT from MCS: ref #2069
2018-08-17 01:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2069  77 58347  6603546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:50:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 01:50:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 01:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:50:35 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-08-17 01:50:51 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-17 01:51:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 01:51:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 01:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:51:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:51:35 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-08-17 01:51:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 01:52:00 [DEBUG   ] Got command TBN from MCS: ref #2089
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-17 01:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     2089   8 58347  6720122 A  ERROR'
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1534470721']
2018-08-17 01:52:00 [DEBUG   ] spawn_process: at 2018-08-17 01:52:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1534470721']
2018-08-17 01:52:00 [INFO    ] Finished spawning TBN in 0.054 s
2018-08-17 01:52:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 01:52:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 01:52:32 [DEBUG   ] Got command RPT from MCS: ref #2092
2018-08-17 01:52:32 [DEBUG   ] summary = ERROR
2018-08-17 01:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2092  13 58347  6752125 A  ERRORERROR'
2018-08-17 01:52:32 [DEBUG   ] Got command RPT from MCS: ref #2093
2018-08-17 01:52:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2093  77 58347  6752317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:52:32 [DEBUG   ] Got command RPT from MCS: ref #2094
2018-08-17 01:52:32 [DEBUG   ] summary = ERROR
2018-08-17 01:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2094  13 58347  6752521 A  ERRORERROR'
2018-08-17 01:52:32 [DEBUG   ] Got command RPT from MCS: ref #2095
2018-08-17 01:52:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2095  77 58347  6752725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:52:32 [DEBUG   ] Got command RPT from MCS: ref #2096
2018-08-17 01:52:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2096  12 58347  6752939 A  ERRORB˜™š'
2018-08-17 01:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:52:35 [DEBUG   ] Finished updating board flags in 1.839 seconds
2018-08-17 01:52:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 01:53:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 01:53:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 01:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:53:35 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-08-17 01:53:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 01:54:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 01:54:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 01:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:54:35 [DEBUG   ] Finished updating board flags in 1.764 seconds
2018-08-17 01:54:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 01:55:03 [DEBUG   ] Got command RPT from MCS: ref #2106
2018-08-17 01:55:03 [DEBUG   ] summary = ERROR
2018-08-17 01:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2106  13 58347  6903549 A  ERRORERROR'
2018-08-17 01:55:03 [DEBUG   ] Got command RPT from MCS: ref #2107
2018-08-17 01:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2107  77 58347  6903550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:55:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 01:55:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 01:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:55:35 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-08-17 01:55:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 01:56:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 01:56:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 01:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:56:35 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-08-17 01:56:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 01:57:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 01:57:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 01:57:32 [DEBUG   ] Got command RPT from MCS: ref #2127
2018-08-17 01:57:32 [DEBUG   ] summary = ERROR
2018-08-17 01:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2127  13 58347  7052205 A  ERRORERROR'
2018-08-17 01:57:32 [DEBUG   ] Got command RPT from MCS: ref #2128
2018-08-17 01:57:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2128  77 58347  7052409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:57:32 [DEBUG   ] Got command RPT from MCS: ref #2129
2018-08-17 01:57:32 [DEBUG   ] summary = ERROR
2018-08-17 01:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2129  13 58347  7052601 A  ERRORERROR'
2018-08-17 01:57:32 [DEBUG   ] Got command RPT from MCS: ref #2130
2018-08-17 01:57:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 01:57:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2130  77 58347  7052805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 01:57:33 [DEBUG   ] Got command RPT from MCS: ref #2131
2018-08-17 01:57:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 01:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2131  12 58347  7053009 A  ERRORB˜™š'
2018-08-17 01:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:57:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 01:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:57:35 [DEBUG   ] Finished updating board flags in 1.523 seconds
2018-08-17 01:57:51 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-08-17 01:58:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 01:58:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 01:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:58:36 [DEBUG   ] Finished updating board flags in 2.262 seconds
2018-08-17 01:58:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 01:59:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 01:59:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 01:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 01:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 01:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 01:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 01:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 01:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 01:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 01:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 01:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 01:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 01:59:36 [DEBUG   ] Finished updating board flags in 2.216 seconds
2018-08-17 01:59:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-17 02:00:03 [DEBUG   ] Got command RPT from MCS: ref #2136
2018-08-17 02:00:03 [DEBUG   ] summary = ERROR
2018-08-17 02:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2136  13 58347  7203541 A  ERRORERROR'
2018-08-17 02:00:03 [DEBUG   ] Got command RPT from MCS: ref #2137
2018-08-17 02:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2137  77 58347  7203542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:00:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 02:00:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 02:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:00:36 [DEBUG   ] Finished updating board flags in 2.120 seconds
2018-08-17 02:00:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 02:01:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 02:01:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 02:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:01:36 [DEBUG   ] Finished updating board flags in 2.047 seconds
2018-08-17 02:01:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 02:02:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 02:02:32 [DEBUG   ] Got command RPT from MCS: ref #2159
2018-08-17 02:02:32 [DEBUG   ] summary = ERROR
2018-08-17 02:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2159  13 58347  7352297 A  ERRORERROR'
2018-08-17 02:02:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 02:02:32 [DEBUG   ] Got command RPT from MCS: ref #2160
2018-08-17 02:02:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2160  77 58347  7352489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:02:32 [DEBUG   ] Got command RPT from MCS: ref #2161
2018-08-17 02:02:32 [DEBUG   ] summary = ERROR
2018-08-17 02:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2161  13 58347  7352693 A  ERRORERROR'
2018-08-17 02:02:32 [DEBUG   ] Got command RPT from MCS: ref #2162
2018-08-17 02:02:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:02:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2162  77 58347  7352897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:02:33 [DEBUG   ] Got command RPT from MCS: ref #2163
2018-08-17 02:02:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2163  12 58347  7353093 A  ERRORB˜™š'
2018-08-17 02:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 02:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:02:36 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-08-17 02:02:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 02:03:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 02:03:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 02:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:03:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 02:03:36 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-08-17 02:03:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 02:04:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 02:04:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 02:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:04:36 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-08-17 02:04:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 02:05:03 [DEBUG   ] Got command RPT from MCS: ref #2169
2018-08-17 02:05:03 [DEBUG   ] summary = ERROR
2018-08-17 02:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2169  13 58347  7503545 A  ERRORERROR'
2018-08-17 02:05:03 [DEBUG   ] Got command RPT from MCS: ref #2170
2018-08-17 02:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2170  77 58347  7503546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:05:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:05:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:05:36 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-08-17 02:05:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 02:06:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 02:06:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:06:35 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 02:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:06:36 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-08-17 02:06:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:07:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:07:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:07:32 [DEBUG   ] Got command RPT from MCS: ref #2190
2018-08-17 02:07:32 [DEBUG   ] summary = ERROR
2018-08-17 02:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2190  13 58347  7652377 A  ERRORERROR'
2018-08-17 02:07:32 [DEBUG   ] Got command RPT from MCS: ref #2191
2018-08-17 02:07:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2191  77 58347  7652569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:07:32 [DEBUG   ] Got command RPT from MCS: ref #2192
2018-08-17 02:07:32 [DEBUG   ] summary = ERROR
2018-08-17 02:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2192  13 58347  7652773 A  ERRORERROR'
2018-08-17 02:07:32 [DEBUG   ] Got command RPT from MCS: ref #2193
2018-08-17 02:07:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2193  77 58347  7652977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:07:33 [DEBUG   ] Got command RPT from MCS: ref #2194
2018-08-17 02:07:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2194  12 58347  7653181 A  ERRORB˜™š'
2018-08-17 02:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:07:36 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-08-17 02:07:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:08:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:08:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 02:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:08:37 [DEBUG   ] Finished updating board flags in 2.267 seconds
2018-08-17 02:08:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 02:09:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:09:32 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 02:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:09:37 [DEBUG   ] Finished updating board flags in 2.122 seconds
2018-08-17 02:09:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 02:10:03 [DEBUG   ] Got command RPT from MCS: ref #2199
2018-08-17 02:10:03 [DEBUG   ] summary = ERROR
2018-08-17 02:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2199  13 58347  7803549 A  ERRORERROR'
2018-08-17 02:10:03 [DEBUG   ] Got command RPT from MCS: ref #2200
2018-08-17 02:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2200  77 58347  7803550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:10:13 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 02:10:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 02:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:10:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 02:10:37 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-08-17 02:10:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 02:11:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 02:11:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 02:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:11:37 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-08-17 02:11:53 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2018-08-17 02:12:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 02:12:32 [DEBUG   ] Got command RPT from MCS: ref #2222
2018-08-17 02:12:32 [DEBUG   ] summary = ERROR
2018-08-17 02:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2222  13 58347  7952454 A  ERRORERROR'
2018-08-17 02:12:32 [DEBUG   ] Got command RPT from MCS: ref #2223
2018-08-17 02:12:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2223  77 58347  7952657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:12:32 [DEBUG   ] Got command RPT from MCS: ref #2224
2018-08-17 02:12:32 [DEBUG   ] summary = ERROR
2018-08-17 02:12:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2224  13 58347  7952861 A  ERRORERROR'
2018-08-17 02:12:33 [DEBUG   ] Got command RPT from MCS: ref #2225
2018-08-17 02:12:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2225  77 58347  7953065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:12:33 [DEBUG   ] Got command RPT from MCS: ref #2226
2018-08-17 02:12:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2226  12 58347  7953257 A  ERRORB˜™š'
2018-08-17 02:12:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 02:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:12:37 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-08-17 02:12:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 02:13:13 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 02:13:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:13:37 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-08-17 02:13:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:14:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:14:33 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 02:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:14:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 02:14:37 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-08-17 02:14:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 02:15:03 [DEBUG   ] Got command RPT from MCS: ref #2236
2018-08-17 02:15:03 [DEBUG   ] summary = ERROR
2018-08-17 02:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2236  13 58347  8103545 A  ERRORERROR'
2018-08-17 02:15:03 [DEBUG   ] Got command RPT from MCS: ref #2237
2018-08-17 02:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2237  77 58347  8103546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:15:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:15:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:15:37 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-08-17 02:15:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 02:16:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 02:16:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:16:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 02:16:37 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-08-17 02:16:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:17:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 02:17:32 [DEBUG   ] Got command RPT from MCS: ref #2257
2018-08-17 02:17:32 [DEBUG   ] summary = ERROR
2018-08-17 02:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2257  13 58347  8252545 A  ERRORERROR'
2018-08-17 02:17:32 [DEBUG   ] Got command RPT from MCS: ref #2258
2018-08-17 02:17:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2258  77 58347  8252739 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:17:32 [DEBUG   ] Got command RPT from MCS: ref #2259
2018-08-17 02:17:32 [DEBUG   ] summary = ERROR
2018-08-17 02:17:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2259  13 58347  8252941 A  ERRORERROR'
2018-08-17 02:17:33 [DEBUG   ] Got command RPT from MCS: ref #2260
2018-08-17 02:17:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2260  77 58347  8253145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:17:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 02:17:33 [DEBUG   ] Got command RPT from MCS: ref #2261
2018-08-17 02:17:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2261  12 58347  8253349 A  ERRORB—™š'
2018-08-17 02:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:17:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 02:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:17:37 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-08-17 02:17:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:18:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:18:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 02:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-17 02:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:18:37 [DEBUG   ] Finished updating board flags in 1.709 seconds
2018-08-17 02:18:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 02:19:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:19:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 02:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 02:19:37 [DEBUG   ] Finished updating board flags in 1.499 seconds
2018-08-17 02:19:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 02:20:03 [DEBUG   ] Got command RPT from MCS: ref #2262
2018-08-17 02:20:03 [DEBUG   ] summary = ERROR
2018-08-17 02:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2262  13 58347  8403550 A  ERRORERROR'
2018-08-17 02:20:03 [DEBUG   ] Got command RPT from MCS: ref #2263
2018-08-17 02:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2263  77 58347  8403550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:20:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 02:20:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 02:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:20:37 [DEBUG   ] Finished updating board flags in 1.480 seconds
2018-08-17 02:20:54 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 02:21:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 02:21:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 02:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:21:37 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-08-17 02:21:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 02:22:14 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-08-17 02:22:32 [DEBUG   ] Got command RPT from MCS: ref #2285
2018-08-17 02:22:32 [DEBUG   ] summary = ERROR
2018-08-17 02:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2285  13 58347  8552629 A  ERRORERROR'
2018-08-17 02:22:32 [DEBUG   ] Got command RPT from MCS: ref #2286
2018-08-17 02:22:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:22:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2286  77 58347  8552833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:22:33 [DEBUG   ] Got command RPT from MCS: ref #2287
2018-08-17 02:22:33 [DEBUG   ] summary = ERROR
2018-08-17 02:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2287  13 58347  8553025 A  ERRORERROR'
2018-08-17 02:22:33 [DEBUG   ] Got command RPT from MCS: ref #2288
2018-08-17 02:22:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2288  77 58347  8553229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:22:33 [DEBUG   ] Got command RPT from MCS: ref #2289
2018-08-17 02:22:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2289  12 58347  8553433 A  ERRORB˜™š'
2018-08-17 02:22:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 02:22:37 [DEBUG   ] Finished updating board flags in 1.483 seconds
2018-08-17 02:22:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 02:23:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:23:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 02:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:23:38 [DEBUG   ] Finished updating board flags in 2.176 seconds
2018-08-17 02:23:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:24:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:24:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:24:38 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-08-17 02:24:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 02:25:03 [DEBUG   ] Got command RPT from MCS: ref #2299
2018-08-17 02:25:03 [DEBUG   ] summary = ERROR
2018-08-17 02:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2299  13 58347  8703549 A  ERRORERROR'
2018-08-17 02:25:03 [DEBUG   ] Got command RPT from MCS: ref #2300
2018-08-17 02:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2300  77 58347  8703550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:25:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:25:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:25:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 02:25:38 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-08-17 02:25:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 02:26:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 02:26:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 02:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:26:38 [DEBUG   ] Finished updating board flags in 1.937 seconds
2018-08-17 02:26:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 02:27:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 02:27:32 [DEBUG   ] Got command RPT from MCS: ref #2320
2018-08-17 02:27:32 [DEBUG   ] summary = ERROR
2018-08-17 02:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2320  13 58347  8852718 A  ERRORERROR'
2018-08-17 02:27:32 [DEBUG   ] Got command RPT from MCS: ref #2321
2018-08-17 02:27:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2321  77 58347  8852909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:27:33 [DEBUG   ] Got command RPT from MCS: ref #2322
2018-08-17 02:27:33 [DEBUG   ] summary = ERROR
2018-08-17 02:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2322  13 58347  8853113 A  ERRORERROR'
2018-08-17 02:27:33 [DEBUG   ] Got command RPT from MCS: ref #2323
2018-08-17 02:27:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2323  77 58347  8853322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:27:33 [DEBUG   ] Got command RPT from MCS: ref #2324
2018-08-17 02:27:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2324  12 58347  8853513 A  ERRORB˜™š'
2018-08-17 02:27:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 02:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 02:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:27:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 02:27:38 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-08-17 02:27:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 02:28:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 02:28:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 02:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:28:38 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-08-17 02:28:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 02:29:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 02:29:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 02:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:29:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:29:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 02:29:38 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-08-17 02:29:55 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-17 02:30:03 [DEBUG   ] Got command RPT from MCS: ref #2329
2018-08-17 02:30:03 [DEBUG   ] summary = ERROR
2018-08-17 02:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2329  13 58347  9003553 A  ERRORERROR'
2018-08-17 02:30:03 [DEBUG   ] Got command RPT from MCS: ref #2330
2018-08-17 02:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2330  77 58347  9003554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:30:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:30:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:30:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-08-17 02:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:30:38 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-08-17 02:30:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:31:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 02:31:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:31:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:31:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 02:31:38 [DEBUG   ] Finished updating board flags in 1.721 seconds
2018-08-17 02:31:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:32:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:32:32 [DEBUG   ] Got command RPT from MCS: ref #2352
2018-08-17 02:32:32 [DEBUG   ] summary = ERROR
2018-08-17 02:32:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2352  13 58347  9152793 A  ERRORERROR'
2018-08-17 02:32:33 [DEBUG   ] Got command RPT from MCS: ref #2353
2018-08-17 02:32:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2353  77 58347  9153001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:32:33 [DEBUG   ] Got command RPT from MCS: ref #2354
2018-08-17 02:32:33 [DEBUG   ] summary = ERROR
2018-08-17 02:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2354  13 58347  9153205 A  ERRORERROR'
2018-08-17 02:32:33 [DEBUG   ] Got command RPT from MCS: ref #2355
2018-08-17 02:32:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2355  77 58347  9153397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:32:33 [DEBUG   ] Got command RPT from MCS: ref #2356
2018-08-17 02:32:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2356  12 58347  9153601 A  ERRORB˜™š'
2018-08-17 02:32:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:32:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:32:38 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-08-17 02:32:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:33:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:33:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:33:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 02:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:33:39 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-08-17 02:33:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 02:34:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 02:34:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:34:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:34:38 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-08-17 02:34:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 02:35:03 [DEBUG   ] Got command RPT from MCS: ref #2362
2018-08-17 02:35:03 [DEBUG   ] summary = ERROR
2018-08-17 02:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2362  13 58347  9303553 A  ERRORERROR'
2018-08-17 02:35:03 [DEBUG   ] Got command RPT from MCS: ref #2363
2018-08-17 02:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2363  77 58347  9303554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:35:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 02:35:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:35:39 [DEBUG   ] Finished updating board flags in 2.201 seconds
2018-08-17 02:35:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:36:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 02:36:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 02:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:36:39 [DEBUG   ] Finished updating board flags in 2.188 seconds
2018-08-17 02:36:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:37:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:37:32 [DEBUG   ] Got command RPT from MCS: ref #2383
2018-08-17 02:37:32 [DEBUG   ] summary = ERROR
2018-08-17 02:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2383  13 58347  9452893 A  ERRORERROR'
2018-08-17 02:37:33 [DEBUG   ] Got command RPT from MCS: ref #2384
2018-08-17 02:37:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2384  77 58347  9453085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:37:33 [DEBUG   ] Got command RPT from MCS: ref #2385
2018-08-17 02:37:33 [DEBUG   ] summary = ERROR
2018-08-17 02:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2385  13 58347  9453289 A  ERRORERROR'
2018-08-17 02:37:33 [DEBUG   ] Got command RPT from MCS: ref #2386
2018-08-17 02:37:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2386  77 58347  9453493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:37:33 [DEBUG   ] Got command RPT from MCS: ref #2387
2018-08-17 02:37:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2387  12 58347  9453685 A  ERRORB˜™š'
2018-08-17 02:37:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 02:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:37:39 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-08-17 02:37:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 02:38:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 02:38:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 02:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:38:39 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-08-17 02:38:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 02:39:15 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 02:39:36 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 02:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:39:39 [DEBUG   ] Finished updating board flags in 1.924 seconds
2018-08-17 02:39:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 02:40:03 [DEBUG   ] Got command RPT from MCS: ref #2392
2018-08-17 02:40:03 [DEBUG   ] summary = ERROR
2018-08-17 02:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2392  13 58347  9603549 A  ERRORERROR'
2018-08-17 02:40:03 [DEBUG   ] Got command RPT from MCS: ref #2393
2018-08-17 02:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2393  77 58347  9603550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:40:16 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-17 02:40:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 02:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-08-17 02:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:40:39 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-17 02:40:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 02:41:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 02:41:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 02:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:41:39 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-08-17 02:41:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 02:42:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 02:42:32 [DEBUG   ] Got command RPT from MCS: ref #2415
2018-08-17 02:42:32 [DEBUG   ] summary = ERROR
2018-08-17 02:42:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2415  13 58347  9752973 A  ERRORERROR'
2018-08-17 02:42:33 [DEBUG   ] Got command RPT from MCS: ref #2416
2018-08-17 02:42:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2416  77 58347  9753177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:42:33 [DEBUG   ] Got command RPT from MCS: ref #2417
2018-08-17 02:42:33 [DEBUG   ] summary = ERROR
2018-08-17 02:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2417  13 58347  9753369 A  ERRORERROR'
2018-08-17 02:42:33 [DEBUG   ] Got command RPT from MCS: ref #2418
2018-08-17 02:42:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2418  77 58347  9753573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:42:33 [DEBUG   ] Got command RPT from MCS: ref #2419
2018-08-17 02:42:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2419  12 58347  9753777 A  ERRORB˜™š'
2018-08-17 02:42:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 02:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:42:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:42:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 02:42:39 [DEBUG   ] Finished updating board flags in 1.840 seconds
2018-08-17 02:42:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 02:43:16 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-17 02:43:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:43:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:43:39 [DEBUG   ] Finished updating board flags in 1.746 seconds
2018-08-17 02:43:56 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 02:44:16 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 02:44:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 02:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:44:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:44:39 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-17 02:44:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 02:45:03 [DEBUG   ] Got command RPT from MCS: ref #2429
2018-08-17 02:45:03 [DEBUG   ] summary = ERROR
2018-08-17 02:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2429  13 58347  9903557 A  ERRORERROR'
2018-08-17 02:45:03 [DEBUG   ] Got command RPT from MCS: ref #2430
2018-08-17 02:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2430  77 58347  9903558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:45:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 02:45:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 02:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:45:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:45:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 02:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:45:39 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-17 02:45:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 02:46:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 02:46:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 02:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:46:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:46:39 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-08-17 02:46:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 02:47:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 02:47:33 [DEBUG   ] Got command RPT from MCS: ref #2449
2018-08-17 02:47:33 [DEBUG   ] summary = ERROR
2018-08-17 02:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2449  13 58347 10053061 A  ERRORERROR'
2018-08-17 02:47:33 [DEBUG   ] Got command RPT from MCS: ref #2451
2018-08-17 02:47:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2451  77 58347 10053253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:47:33 [DEBUG   ] Got command RPT from MCS: ref #2452
2018-08-17 02:47:33 [DEBUG   ] summary = ERROR
2018-08-17 02:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2452  13 58347 10053457 A  ERRORERROR'
2018-08-17 02:47:33 [DEBUG   ] Got command RPT from MCS: ref #2453
2018-08-17 02:47:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2453  77 58347 10053661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:47:33 [DEBUG   ] Got command RPT from MCS: ref #2454
2018-08-17 02:47:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2454  12 58347 10053865 A  ERRORB˜™š'
2018-08-17 02:47:37 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 02:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:47:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 02:47:39 [DEBUG   ] Finished updating board flags in 1.473 seconds
2018-08-17 02:47:57 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 02:48:18 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 02:48:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 02:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:48:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:48:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 02:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:48:39 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-08-17 02:48:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 02:49:18 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-08-17 02:49:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 02:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:49:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 02:49:40 [DEBUG   ] Finished updating board flags in 2.216 seconds
2018-08-17 02:49:58 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-08-17 02:50:03 [DEBUG   ] Got command RPT from MCS: ref #2455
2018-08-17 02:50:03 [DEBUG   ] summary = ERROR
2018-08-17 02:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2455  13 58347 10203561 A  ERRORERROR'
2018-08-17 02:50:03 [DEBUG   ] Got command RPT from MCS: ref #2456
2018-08-17 02:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2456  77 58347 10203562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:50:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:50:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:50:40 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-08-17 02:50:58 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 02:51:18 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 02:51:38 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 02:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 02:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:51:40 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-08-17 02:51:59 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-08-17 02:52:19 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 02:52:33 [DEBUG   ] Got command RPT from MCS: ref #2478
2018-08-17 02:52:33 [DEBUG   ] summary = ERROR
2018-08-17 02:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2478  13 58347 10353145 A  ERRORERROR'
2018-08-17 02:52:33 [DEBUG   ] Got command RPT from MCS: ref #2479
2018-08-17 02:52:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2479  77 58347 10353349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:52:33 [DEBUG   ] Got command RPT from MCS: ref #2480
2018-08-17 02:52:33 [DEBUG   ] summary = ERROR
2018-08-17 02:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2480  13 58347 10353541 A  ERRORERROR'
2018-08-17 02:52:33 [DEBUG   ] Got command RPT from MCS: ref #2481
2018-08-17 02:52:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2481  77 58347 10353745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:52:33 [DEBUG   ] Got command RPT from MCS: ref #2482
2018-08-17 02:52:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2482  12 58347 10353949 A  ERRORB—™š'
2018-08-17 02:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:52:39 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2018-08-17 02:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:52:40 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-08-17 02:52:59 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2018-08-17 02:53:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 02:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:53:39 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-08-17 02:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:53:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 02:53:40 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-08-17 02:53:59 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2018-08-17 02:54:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 02:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 02:54:39 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-08-17 02:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:54:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 02:54:40 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-17 02:54:59 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-17 02:55:03 [DEBUG   ] Got command RPT from MCS: ref #2492
2018-08-17 02:55:03 [DEBUG   ] summary = ERROR
2018-08-17 02:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2492  13 58347 10503561 A  ERRORERROR'
2018-08-17 02:55:03 [DEBUG   ] Got command RPT from MCS: ref #2493
2018-08-17 02:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2493  77 58347 10503562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:55:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 02:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:55:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:55:40 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 02:55:40 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-08-17 02:56:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 02:56:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 02:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:56:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:56:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 02:56:40 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2018-08-17 02:56:40 [DEBUG   ] Finished updating board flags in 1.637 seconds
2018-08-17 02:57:00 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2018-08-17 02:57:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 02:57:33 [DEBUG   ] Got command RPT from MCS: ref #2513
2018-08-17 02:57:33 [DEBUG   ] summary = ERROR
2018-08-17 02:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2513  13 58347 10653225 A  ERRORERROR'
2018-08-17 02:57:33 [DEBUG   ] Got command RPT from MCS: ref #2514
2018-08-17 02:57:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2514  77 58347 10653429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:57:33 [DEBUG   ] Got command RPT from MCS: ref #2515
2018-08-17 02:57:33 [DEBUG   ] summary = ERROR
2018-08-17 02:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2515  13 58347 10653633 A  ERRORERROR'
2018-08-17 02:57:33 [DEBUG   ] Got command RPT from MCS: ref #2516
2018-08-17 02:57:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 02:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2516  77 58347 10653837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 02:57:34 [DEBUG   ] Got command RPT from MCS: ref #2517
2018-08-17 02:57:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 02:57:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2517  12 58347 10654029 A  ERRORB—™š'
2018-08-17 02:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:57:40 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2018-08-17 02:57:40 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-08-17 02:58:00 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-08-17 02:58:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 02:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:58:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:58:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 02:58:40 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2018-08-17 02:58:40 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-08-17 02:59:00 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-17 02:59:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 02:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 02:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 02:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 02:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 02:59:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 02:59:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 02:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 02:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 02:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 02:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 02:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 02:59:40 [DEBUG   ] Finished updating ant stats in 0.641 seconds
2018-08-17 02:59:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 02:59:40 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-08-17 03:00:00 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2018-08-17 03:00:03 [DEBUG   ] Got command RPT from MCS: ref #2522
2018-08-17 03:00:03 [DEBUG   ] summary = ERROR
2018-08-17 03:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2522  13 58347 10803557 A  ERRORERROR'
2018-08-17 03:00:03 [DEBUG   ] Got command RPT from MCS: ref #2523
2018-08-17 03:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2523  77 58347 10803558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:00:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 03:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:00:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:00:40 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-08-17 03:00:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 03:01:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 03:01:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:01:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:01:40 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-08-17 03:01:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 03:02:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:02:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:02:33 [DEBUG   ] Got command RPT from MCS: ref #2544
2018-08-17 03:02:33 [DEBUG   ] summary = ERROR
2018-08-17 03:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2544  13 58347 10953313 A  ERRORERROR'
2018-08-17 03:02:33 [DEBUG   ] Got command RPT from MCS: ref #2546
2018-08-17 03:02:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2546  77 58347 10953517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:02:33 [DEBUG   ] Got command RPT from MCS: ref #2547
2018-08-17 03:02:33 [DEBUG   ] summary = ERROR
2018-08-17 03:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2547  13 58347 10953721 A  ERRORERROR'
2018-08-17 03:02:33 [DEBUG   ] Got command RPT from MCS: ref #2548
2018-08-17 03:02:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2548  77 58347 10953913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:02:34 [DEBUG   ] Got command RPT from MCS: ref #2549
2018-08-17 03:02:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2549  12 58347 10954117 A  ERRORB—™š'
2018-08-17 03:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:02:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:02:40 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-08-17 03:02:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:03:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 03:03:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:03:41 [DEBUG   ] Finished updating ant stats in 1.254 seconds
2018-08-17 03:03:41 [DEBUG   ] Finished updating board flags in 2.315 seconds
2018-08-17 03:04:01 [DEBUG   ] Finished updating ant stats in 1.152 seconds
2018-08-17 03:04:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 03:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:04:41 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2018-08-17 03:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 03:04:41 [DEBUG   ] Finished updating board flags in 2.118 seconds
2018-08-17 03:05:01 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-17 03:05:03 [DEBUG   ] Got command RPT from MCS: ref #2555
2018-08-17 03:05:03 [DEBUG   ] summary = ERROR
2018-08-17 03:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2555  13 58347 11103561 A  ERRORERROR'
2018-08-17 03:05:03 [DEBUG   ] Got command RPT from MCS: ref #2556
2018-08-17 03:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2556  77 58347 11103562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:05:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 03:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:05:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:05:41 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-08-17 03:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 03:05:41 [DEBUG   ] Finished updating board flags in 2.031 seconds
2018-08-17 03:06:01 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2018-08-17 03:06:22 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 03:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:06:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 03:06:41 [DEBUG   ] Finished updating board flags in 1.964 seconds
2018-08-17 03:06:42 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 03:07:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 03:07:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:07:33 [DEBUG   ] Got command RPT from MCS: ref #2576
2018-08-17 03:07:33 [DEBUG   ] summary = ERROR
2018-08-17 03:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2576  13 58347 11253393 A  ERRORERROR'
2018-08-17 03:07:33 [DEBUG   ] Got command RPT from MCS: ref #2577
2018-08-17 03:07:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2577  77 58347 11253597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:07:33 [DEBUG   ] Got command RPT from MCS: ref #2578
2018-08-17 03:07:33 [DEBUG   ] summary = ERROR
2018-08-17 03:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2578  13 58347 11253801 A  ERRORERROR'
2018-08-17 03:07:34 [DEBUG   ] Got command RPT from MCS: ref #2579
2018-08-17 03:07:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2579  77 58347 11254005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:07:34 [DEBUG   ] Got command RPT from MCS: ref #2580
2018-08-17 03:07:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2580  12 58347 11254197 A  ERRORB˜™š'
2018-08-17 03:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:07:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:07:41 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-08-17 03:07:42 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-08-17 03:08:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:08:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:08:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:08:41 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-08-17 03:08:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 03:09:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 03:09:22 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 03:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:09:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:09:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 03:09:41 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-08-17 03:09:42 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-17 03:10:03 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 03:10:03 [DEBUG   ] Got command RPT from MCS: ref #2585
2018-08-17 03:10:03 [DEBUG   ] summary = ERROR
2018-08-17 03:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2585  13 58347 11403561 A  ERRORERROR'
2018-08-17 03:10:03 [DEBUG   ] Got command RPT from MCS: ref #2586
2018-08-17 03:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2586  77 58347 11403562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:10:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 03:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:10:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:10:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 03:10:41 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-08-17 03:10:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:11:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:11:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 03:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:11:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:11:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 03:11:41 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-08-17 03:11:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:12:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:12:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:12:33 [DEBUG   ] Got command RPT from MCS: ref #2608
2018-08-17 03:12:33 [DEBUG   ] summary = ERROR
2018-08-17 03:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2608  13 58347 11553481 A  ERRORERROR'
2018-08-17 03:12:33 [DEBUG   ] Got command RPT from MCS: ref #2609
2018-08-17 03:12:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2609  77 58347 11553685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:12:33 [DEBUG   ] Got command RPT from MCS: ref #2610
2018-08-17 03:12:33 [DEBUG   ] summary = ERROR
2018-08-17 03:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2610  13 58347 11553889 A  ERRORERROR'
2018-08-17 03:12:34 [DEBUG   ] Got command RPT from MCS: ref #2611
2018-08-17 03:12:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2611  77 58347 11554081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:12:34 [DEBUG   ] Got command RPT from MCS: ref #2612
2018-08-17 03:12:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2612  12 58347 11554285 A  ERRORB—™š'
2018-08-17 03:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:12:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:12:41 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-08-17 03:12:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:13:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:13:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 03:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:13:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:13:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 03:13:41 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-08-17 03:13:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:14:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 03:14:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:14:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:14:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 03:14:42 [DEBUG   ] Finished updating board flags in 2.240 seconds
2018-08-17 03:14:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 03:15:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:15:03 [DEBUG   ] Got command RPT from MCS: ref #2622
2018-08-17 03:15:03 [DEBUG   ] summary = ERROR
2018-08-17 03:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2622  13 58347 11703557 A  ERRORERROR'
2018-08-17 03:15:03 [DEBUG   ] Got command RPT from MCS: ref #2623
2018-08-17 03:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2623  77 58347 11703558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:15:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 03:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:15:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:15:42 [DEBUG   ] Finished updating board flags in 2.258 seconds
2018-08-17 03:15:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:16:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:16:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 03:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:16:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:16:41 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:16:42 [DEBUG   ] Finished updating board flags in 2.111 seconds
2018-08-17 03:16:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 03:17:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 03:17:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:17:33 [DEBUG   ] Got command RPT from MCS: ref #2642
2018-08-17 03:17:33 [DEBUG   ] summary = ERROR
2018-08-17 03:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2642  13 58347 11853565 A  ERRORERROR'
2018-08-17 03:17:33 [DEBUG   ] Got command RPT from MCS: ref #2644
2018-08-17 03:17:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2644  77 58347 11853769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:17:33 [DEBUG   ] Got command RPT from MCS: ref #2645
2018-08-17 03:17:33 [DEBUG   ] summary = ERROR
2018-08-17 03:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2645  13 58347 11853973 A  ERRORERROR'
2018-08-17 03:17:34 [DEBUG   ] Got command RPT from MCS: ref #2646
2018-08-17 03:17:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2646  77 58347 11854165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:17:34 [DEBUG   ] Got command RPT from MCS: ref #2647
2018-08-17 03:17:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2647  12 58347 11854369 A  ERRORB˜™š'
2018-08-17 03:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:17:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:17:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:17:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 03:17:43 [DEBUG   ] Finished updating board flags in 2.947 seconds
2018-08-17 03:18:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 03:18:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 03:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:18:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:18:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 03:18:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 03:18:42 [DEBUG   ] Finished updating board flags in 1.876 seconds
2018-08-17 03:18:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 03:19:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 03:19:23 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 03:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:19:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:19:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 03:19:42 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-17 03:19:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 03:20:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 03:20:03 [DEBUG   ] Got command RPT from MCS: ref #2648
2018-08-17 03:20:03 [DEBUG   ] summary = ERROR
2018-08-17 03:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2648  13 58347 12003565 A  ERRORERROR'
2018-08-17 03:20:03 [DEBUG   ] Got command RPT from MCS: ref #2649
2018-08-17 03:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2649  77 58347 12003566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:20:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 03:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:20:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:20:42 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-08-17 03:20:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 03:21:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 03:21:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 03:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:21:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:21:42 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-08-17 03:21:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 03:22:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 03:22:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 03:22:33 [DEBUG   ] Got command RPT from MCS: ref #2671
2018-08-17 03:22:33 [DEBUG   ] summary = ERROR
2018-08-17 03:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2671  13 58347 12153657 A  ERRORERROR'
2018-08-17 03:22:33 [DEBUG   ] Got command RPT from MCS: ref #2672
2018-08-17 03:22:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2672  77 58347 12153849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:22:34 [DEBUG   ] Got command RPT from MCS: ref #2673
2018-08-17 03:22:34 [DEBUG   ] summary = ERROR
2018-08-17 03:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2673  13 58347 12154053 A  ERRORERROR'
2018-08-17 03:22:34 [DEBUG   ] Got command RPT from MCS: ref #2674
2018-08-17 03:22:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2674  77 58347 12154257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:22:34 [DEBUG   ] Got command RPT from MCS: ref #2675
2018-08-17 03:22:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2675  12 58347 12154461 A  ERRORB˜™š'
2018-08-17 03:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:22:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:22:42 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-08-17 03:22:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 03:23:03 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 03:23:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 03:23:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:23:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:23:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:23:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:23:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:23:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 03:23:42 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-08-17 03:23:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 03:24:04 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-17 03:24:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 03:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:24:43 [DEBUG   ] Finished updating board flags in 2.193 seconds
2018-08-17 03:24:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:25:03 [DEBUG   ] Got command RPT from MCS: ref #2685
2018-08-17 03:25:03 [DEBUG   ] summary = ERROR
2018-08-17 03:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2685  13 58347 12303566 A  ERRORERROR'
2018-08-17 03:25:03 [DEBUG   ] Got command RPT from MCS: ref #2686
2018-08-17 03:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2686  77 58347 12303566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:25:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:25:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:25:43 [DEBUG   ] Finished updating board flags in 1.957 seconds
2018-08-17 03:25:44 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-08-17 03:26:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 03:26:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 03:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:26:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:26:43 [DEBUG   ] Finished updating board flags in 1.833 seconds
2018-08-17 03:26:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 03:27:04 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-08-17 03:27:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 03:27:33 [DEBUG   ] Got command RPT from MCS: ref #2706
2018-08-17 03:27:33 [DEBUG   ] summary = ERROR
2018-08-17 03:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2706  13 58347 12453733 A  ERRORERROR'
2018-08-17 03:27:33 [DEBUG   ] Got command RPT from MCS: ref #2707
2018-08-17 03:27:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2707  77 58347 12453937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:27:34 [DEBUG   ] Got command RPT from MCS: ref #2708
2018-08-17 03:27:34 [DEBUG   ] summary = ERROR
2018-08-17 03:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2708  13 58347 12454141 A  ERRORERROR'
2018-08-17 03:27:34 [DEBUG   ] Got command RPT from MCS: ref #2709
2018-08-17 03:27:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2709  77 58347 12454345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:27:34 [DEBUG   ] Got command RPT from MCS: ref #2710
2018-08-17 03:27:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2710  12 58347 12454537 A  ERRORB˜™š'
2018-08-17 03:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:27:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:27:43 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-08-17 03:27:44 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-17 03:28:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 03:28:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 03:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:28:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:28:43 [DEBUG   ] Finished updating board flags in 1.727 seconds
2018-08-17 03:28:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 03:29:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 03:29:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 03:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:29:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:29:43 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-17 03:29:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 03:30:03 [DEBUG   ] Got command RPT from MCS: ref #2715
2018-08-17 03:30:03 [DEBUG   ] summary = ERROR
2018-08-17 03:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2715  13 58347 12603565 A  ERRORERROR'
2018-08-17 03:30:03 [DEBUG   ] Got command RPT from MCS: ref #2716
2018-08-17 03:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2716  77 58347 12603566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:30:05 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-17 03:30:25 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 03:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:30:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:30:43 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-08-17 03:30:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 03:31:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:31:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:31:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:31:43 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-08-17 03:31:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:32:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:32:25 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-17 03:32:33 [DEBUG   ] Got command RPT from MCS: ref #2737
2018-08-17 03:32:33 [DEBUG   ] summary = ERROR
2018-08-17 03:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2737  13 58347 12753829 A  ERRORERROR'
2018-08-17 03:32:34 [DEBUG   ] Got command RPT from MCS: ref #2739
2018-08-17 03:32:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2739  77 58347 12754021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:32:34 [DEBUG   ] Got command RPT from MCS: ref #2740
2018-08-17 03:32:34 [DEBUG   ] summary = ERROR
2018-08-17 03:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2740  13 58347 12754225 A  ERRORERROR'
2018-08-17 03:32:34 [DEBUG   ] Got command RPT from MCS: ref #2741
2018-08-17 03:32:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2741  77 58347 12754429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:32:34 [DEBUG   ] Got command RPT from MCS: ref #2742
2018-08-17 03:32:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2742  12 58347 12754621 A  ERRORB—™š'
2018-08-17 03:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:32:44 [DEBUG   ] Finished updating board flags in 2.072 seconds
2018-08-17 03:32:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:33:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 03:33:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 03:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:33:44 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-08-17 03:33:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:34:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:34:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 03:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:34:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 03:34:44 [DEBUG   ] Finished updating board flags in 1.841 seconds
2018-08-17 03:34:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 03:35:03 [DEBUG   ] Got command RPT from MCS: ref #2748
2018-08-17 03:35:03 [DEBUG   ] summary = ERROR
2018-08-17 03:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2748  13 58347 12903561 A  ERRORERROR'
2018-08-17 03:35:03 [DEBUG   ] Got command RPT from MCS: ref #2749
2018-08-17 03:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2749  77 58347 12903562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:35:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 03:35:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 03:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:35:44 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-08-17 03:35:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 03:36:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 03:36:25 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 03:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:36:43 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:36:44 [DEBUG   ] Finished updating board flags in 1.702 seconds
2018-08-17 03:36:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 03:37:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 03:37:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:37:33 [DEBUG   ] Got command RPT from MCS: ref #2769
2018-08-17 03:37:33 [DEBUG   ] summary = ERROR
2018-08-17 03:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2769  13 58347 13053913 A  ERRORERROR'
2018-08-17 03:37:34 [DEBUG   ] Got command RPT from MCS: ref #2770
2018-08-17 03:37:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2770  77 58347 13054117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:37:34 [DEBUG   ] Got command RPT from MCS: ref #2771
2018-08-17 03:37:34 [DEBUG   ] summary = ERROR
2018-08-17 03:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2771  13 58347 13054309 A  ERRORERROR'
2018-08-17 03:37:34 [DEBUG   ] Got command RPT from MCS: ref #2772
2018-08-17 03:37:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2772  77 58347 13054513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:37:34 [DEBUG   ] Got command RPT from MCS: ref #2773
2018-08-17 03:37:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2773  12 58347 13054717 A  ERRORB˜™š'
2018-08-17 03:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:37:43 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:37:44 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-08-17 03:37:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:38:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 03:38:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:38:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:38:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:38:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:38:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:38:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:38:44 [DEBUG   ] Finished updating board flags in 1.655 seconds
2018-08-17 03:38:46 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-17 03:39:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 03:39:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 03:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:39:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:39:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 03:39:44 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-08-17 03:39:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 03:40:03 [DEBUG   ] Got command RPT from MCS: ref #2778
2018-08-17 03:40:03 [DEBUG   ] summary = ERROR
2018-08-17 03:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2778  13 58347 13203565 A  ERRORERROR'
2018-08-17 03:40:03 [DEBUG   ] Got command RPT from MCS: ref #2779
2018-08-17 03:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2779  77 58347 13203566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:40:06 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-08-17 03:40:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 03:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:40:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:40:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 03:40:44 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-08-17 03:40:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 03:41:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 03:41:26 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-17 03:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:41:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:41:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:41:44 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-08-17 03:41:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 03:42:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:42:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:42:34 [DEBUG   ] Got command RPT from MCS: ref #2801
2018-08-17 03:42:34 [DEBUG   ] summary = ERROR
2018-08-17 03:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2801  13 58347 13354001 A  ERRORERROR'
2018-08-17 03:42:34 [DEBUG   ] Got command RPT from MCS: ref #2802
2018-08-17 03:42:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2802  77 58347 13354205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:42:34 [DEBUG   ] Got command RPT from MCS: ref #2803
2018-08-17 03:42:34 [DEBUG   ] summary = ERROR
2018-08-17 03:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2803  13 58347 13354397 A  ERRORERROR'
2018-08-17 03:42:34 [DEBUG   ] Got command RPT from MCS: ref #2804
2018-08-17 03:42:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2804  77 58347 13354601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:42:34 [DEBUG   ] Got command RPT from MCS: ref #2805
2018-08-17 03:42:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:42:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2805  12 58347 13354805 A  ERRORB—™š'
2018-08-17 03:42:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:42:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:42:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:42:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:42:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:42:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:42:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-08-17 03:42:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-17 03:42:44 [DEBUG   ] Finished updating board flags in 1.379 seconds
2018-08-17 03:42:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:43:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:43:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:43:45 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-08-17 03:43:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:44:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 03:44:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 03:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:44:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-08-17 03:44:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-17 03:44:45 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-08-17 03:44:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:45:03 [DEBUG   ] Got command RPT from MCS: ref #2815
2018-08-17 03:45:03 [DEBUG   ] summary = ERROR
2018-08-17 03:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2815  13 58347 13503573 A  ERRORERROR'
2018-08-17 03:45:03 [DEBUG   ] Got command RPT from MCS: ref #2816
2018-08-17 03:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2816  77 58347 13503574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:45:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:45:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:45:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:45:45 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-08-17 03:45:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:46:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 03:46:27 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-08-17 03:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:46:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:46:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:46:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-08-17 03:46:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-08-17 03:46:45 [DEBUG   ] Finished updating board flags in 1.922 seconds
2018-08-17 03:46:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 03:47:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 03:47:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 03:47:34 [DEBUG   ] Got command RPT from MCS: ref #2835
2018-08-17 03:47:34 [DEBUG   ] summary = ERROR
2018-08-17 03:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2835  13 58347 13654081 A  ERRORERROR'
2018-08-17 03:47:34 [DEBUG   ] Got command RPT from MCS: ref #2837
2018-08-17 03:47:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2837  77 58347 13654285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:47:34 [DEBUG   ] Got command RPT from MCS: ref #2838
2018-08-17 03:47:34 [DEBUG   ] summary = ERROR
2018-08-17 03:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2838  13 58347 13654489 A  ERRORERROR'
2018-08-17 03:47:34 [DEBUG   ] Got command RPT from MCS: ref #2839
2018-08-17 03:47:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2839  77 58347 13654681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:47:34 [DEBUG   ] Got command RPT from MCS: ref #2840
2018-08-17 03:47:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:47:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2840  12 58347 13654885 A  ERRORB—™š'
2018-08-17 03:47:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:47:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:47:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:47:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:47:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:47:45 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-08-17 03:47:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 03:48:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 03:48:28 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-17 03:48:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:48:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:48:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:48:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:48:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:48:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:48:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 03:48:45 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-08-17 03:48:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 03:49:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:49:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 03:49:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:49:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:49:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:49:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:49:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:49:45 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-08-17 03:49:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 03:50:03 [DEBUG   ] Got command RPT from MCS: ref #2841
2018-08-17 03:50:03 [DEBUG   ] summary = ERROR
2018-08-17 03:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2841  13 58347 13803573 A  ERRORERROR'
2018-08-17 03:50:03 [DEBUG   ] Got command RPT from MCS: ref #2842
2018-08-17 03:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2842  77 58347 13803574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:50:08 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-08-17 03:50:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:50:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:50:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:50:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:50:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:50:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:50:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:50:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:50:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:50:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:50:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:50:45 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-08-17 03:50:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 03:51:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:51:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:51:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:51:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:51:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:51:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:51:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:51:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 03:51:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:51:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:51:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:51:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:51:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:51:45 [DEBUG   ] Finished updating board flags in 1.649 seconds
2018-08-17 03:51:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 03:52:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 03:52:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 03:52:34 [DEBUG   ] Got command RPT from MCS: ref #2864
2018-08-17 03:52:34 [DEBUG   ] summary = ERROR
2018-08-17 03:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2864  13 58347 13954161 A  ERRORERROR'
2018-08-17 03:52:34 [DEBUG   ] Got command RPT from MCS: ref #2865
2018-08-17 03:52:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2865  77 58347 13954365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:52:34 [DEBUG   ] Got command RPT from MCS: ref #2866
2018-08-17 03:52:34 [DEBUG   ] summary = ERROR
2018-08-17 03:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2866  13 58347 13954569 A  ERRORERROR'
2018-08-17 03:52:34 [DEBUG   ] Got command RPT from MCS: ref #2867
2018-08-17 03:52:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2867  77 58347 13954773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:52:34 [DEBUG   ] Got command RPT from MCS: ref #2868
2018-08-17 03:52:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:52:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2868  12 58347 13954965 A  ERRORB—™š'
2018-08-17 03:52:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:52:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:52:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:52:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:52:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:52:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:52:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:52:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:52:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:52:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:52:45 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-08-17 03:52:48 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 03:53:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 03:53:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 03:53:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:53:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:53:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:53:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:53:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:53:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:53:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:53:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:53:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:53:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:53:45 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-08-17 03:53:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 03:54:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 03:54:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 03:54:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:54:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:54:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:54:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:54:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:54:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:54:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:54:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:54:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:54:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:54:45 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-08-17 03:54:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 03:55:03 [DEBUG   ] Got command RPT from MCS: ref #2878
2018-08-17 03:55:03 [DEBUG   ] summary = ERROR
2018-08-17 03:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2878  13 58347 14103569 A  ERRORERROR'
2018-08-17 03:55:03 [DEBUG   ] Got command RPT from MCS: ref #2879
2018-08-17 03:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2879  77 58347 14103570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:55:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 03:55:28 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-17 03:55:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:55:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:55:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:55:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:55:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:55:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:55:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:55:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:55:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:55:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:55:45 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-08-17 03:55:49 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 03:56:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 03:56:29 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-17 03:56:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:56:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:56:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:56:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:56:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:56:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:56:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:56:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:56:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:56:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:56:45 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-08-17 03:56:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:57:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 03:57:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 03:57:34 [DEBUG   ] Got command RPT from MCS: ref #2899
2018-08-17 03:57:34 [DEBUG   ] summary = ERROR
2018-08-17 03:57:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2899  13 58347 14254257 A  ERRORERROR'
2018-08-17 03:57:34 [DEBUG   ] Got command RPT from MCS: ref #2900
2018-08-17 03:57:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:57:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2900  77 58347 14254449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:57:34 [DEBUG   ] Got command RPT from MCS: ref #2901
2018-08-17 03:57:34 [DEBUG   ] summary = ERROR
2018-08-17 03:57:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2901  13 58347 14254653 A  ERRORERROR'
2018-08-17 03:57:34 [DEBUG   ] Got command RPT from MCS: ref #2902
2018-08-17 03:57:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 03:57:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2902  77 58347 14254857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 03:57:35 [DEBUG   ] Got command RPT from MCS: ref #2903
2018-08-17 03:57:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 03:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2903  12 58347 14255061 A  ERRORB—™š'
2018-08-17 03:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:57:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:57:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:57:45 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-08-17 03:57:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 03:58:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 03:58:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 03:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:58:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:58:46 [DEBUG   ] Finished updating board flags in 2.185 seconds
2018-08-17 03:58:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 03:59:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:59:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 03:59:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 03:59:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 03:59:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 03:59:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 03:59:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 03:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 03:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 03:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 03:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 03:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 03:59:46 [DEBUG   ] Finished updating board flags in 2.056 seconds
2018-08-17 03:59:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 04:00:03 [DEBUG   ] Got command RPT from MCS: ref #2908
2018-08-17 04:00:03 [DEBUG   ] summary = ERROR
2018-08-17 04:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2908  13 58347 14403569 A  ERRORERROR'
2018-08-17 04:00:03 [DEBUG   ] Got command RPT from MCS: ref #2909
2018-08-17 04:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2909  77 58347 14403570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:00:09 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 04:00:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:00:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:00:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:00:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:00:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:00:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:00:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:00:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:00:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:00:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:00:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:00:46 [DEBUG   ] Finished updating board flags in 1.861 seconds
2018-08-17 04:00:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:01:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:01:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:01:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:01:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:01:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:01:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:01:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:01:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:01:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 04:01:46 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-08-17 04:01:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 04:02:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 04:02:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 04:02:34 [DEBUG   ] Got command RPT from MCS: ref #2930
2018-08-17 04:02:34 [DEBUG   ] summary = ERROR
2018-08-17 04:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2930  13 58347 14554345 A  ERRORERROR'
2018-08-17 04:02:34 [DEBUG   ] Got command RPT from MCS: ref #2932
2018-08-17 04:02:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2932  77 58347 14554537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:02:34 [DEBUG   ] Got command RPT from MCS: ref #2933
2018-08-17 04:02:34 [DEBUG   ] summary = ERROR
2018-08-17 04:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2933  13 58347 14554741 A  ERRORERROR'
2018-08-17 04:02:34 [DEBUG   ] Got command RPT from MCS: ref #2934
2018-08-17 04:02:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:02:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2934  77 58347 14554945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:02:35 [DEBUG   ] Got command RPT from MCS: ref #2935
2018-08-17 04:02:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2935  12 58347 14555137 A  ERRORB—™š'
2018-08-17 04:02:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:02:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:02:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:02:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:02:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:02:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:02:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:02:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:02:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:02:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:02:46 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-17 04:02:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 04:03:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 04:03:30 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-17 04:03:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:03:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:03:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:03:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:03:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:03:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:03:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:03:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:03:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:03:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:03:46 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-08-17 04:03:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 04:04:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 04:04:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 04:04:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:04:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:04:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:04:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:04:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:04:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:04:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:04:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:04:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:04:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:04:46 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-17 04:04:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 04:05:03 [DEBUG   ] Got command RPT from MCS: ref #2941
2018-08-17 04:05:03 [DEBUG   ] summary = ERROR
2018-08-17 04:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2941  13 58347 14703574 A  ERRORERROR'
2018-08-17 04:05:03 [DEBUG   ] Got command RPT from MCS: ref #2942
2018-08-17 04:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2942  77 58347 14703574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:05:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 04:05:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 04:05:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:05:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:05:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:05:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:05:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:05:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:05:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:05:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:05:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:05:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:05:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 04:05:46 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-08-17 04:05:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 04:06:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 04:06:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 04:06:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:06:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:06:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:06:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:06:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:06:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:06:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:06:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:06:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:06:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:06:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:06:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 04:06:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 04:06:46 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-08-17 04:06:50 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-08-17 04:07:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 04:07:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 04:07:34 [DEBUG   ] Got command RPT from MCS: ref #2962
2018-08-17 04:07:34 [DEBUG   ] summary = ERROR
2018-08-17 04:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2962  13 58347 14854425 A  ERRORERROR'
2018-08-17 04:07:34 [DEBUG   ] Got command RPT from MCS: ref #2963
2018-08-17 04:07:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2963  77 58347 14854629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:07:34 [DEBUG   ] Got command RPT from MCS: ref #2964
2018-08-17 04:07:34 [DEBUG   ] summary = ERROR
2018-08-17 04:07:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2964  13 58347 14854833 A  ERRORERROR'
2018-08-17 04:07:35 [DEBUG   ] Got command RPT from MCS: ref #2965
2018-08-17 04:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2965  77 58347 14855025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:07:35 [DEBUG   ] Got command RPT from MCS: ref #2966
2018-08-17 04:07:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2966  12 58347 14855229 A  ERRORB—™š'
2018-08-17 04:07:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:07:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:07:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:07:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:07:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:07:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:07:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:07:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:07:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:07:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:07:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:07:46 [DEBUG   ] Finished updating board flags in 1.476 seconds
2018-08-17 04:07:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 04:08:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 04:08:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 04:08:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:08:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:08:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:08:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:08:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:08:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:08:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:08:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:08:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:08:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:08:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:08:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 04:08:46 [DEBUG   ] Finished updating board flags in 1.533 seconds
2018-08-17 04:08:50 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 04:09:10 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 04:09:31 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 04:09:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:09:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:09:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:09:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:09:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:09:47 [DEBUG   ] Finished updating board flags in 2.201 seconds
2018-08-17 04:09:51 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-08-17 04:10:03 [DEBUG   ] Got command RPT from MCS: ref #2971
2018-08-17 04:10:03 [DEBUG   ] summary = ERROR
2018-08-17 04:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2971  13 58347 15003573 A  ERRORERROR'
2018-08-17 04:10:03 [DEBUG   ] Got command RPT from MCS: ref #2972
2018-08-17 04:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2972  77 58347 15003574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:10:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:10:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 04:10:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:10:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:10:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:10:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:10:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:10:47 [DEBUG   ] Finished updating board flags in 2.110 seconds
2018-08-17 04:10:51 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-08-17 04:11:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 04:11:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 04:11:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:11:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:11:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:11:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:11:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:11:47 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-08-17 04:11:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 04:12:11 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-08-17 04:12:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:12:34 [DEBUG   ] Got command RPT from MCS: ref #2994
2018-08-17 04:12:34 [DEBUG   ] summary = ERROR
2018-08-17 04:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2994  13 58347 15154517 A  ERRORERROR'
2018-08-17 04:12:34 [DEBUG   ] Got command RPT from MCS: ref #2995
2018-08-17 04:12:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2995  77 58347 15154721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:12:34 [DEBUG   ] Got command RPT from MCS: ref #2996
2018-08-17 04:12:34 [DEBUG   ] summary = ERROR
2018-08-17 04:12:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2996  13 58347 15154913 A  ERRORERROR'
2018-08-17 04:12:35 [DEBUG   ] Got command RPT from MCS: ref #2997
2018-08-17 04:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2997  77 58347 15155117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:12:35 [DEBUG   ] Got command RPT from MCS: ref #2998
2018-08-17 04:12:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     2998  12 58347 15155321 A  ERRORB—™š'
2018-08-17 04:12:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:12:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:12:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:12:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:12:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:12:47 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-08-17 04:12:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:13:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 04:13:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:13:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:13:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:13:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:13:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:13:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:13:47 [DEBUG   ] Finished updating board flags in 1.852 seconds
2018-08-17 04:13:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:14:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 04:14:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:14:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:14:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:14:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:14:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:14:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:14:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:14:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:14:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:14:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:14:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:14:47 [DEBUG   ] Finished updating board flags in 1.759 seconds
2018-08-17 04:14:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 04:15:03 [DEBUG   ] Got command RPT from MCS: ref #3008
2018-08-17 04:15:03 [DEBUG   ] summary = ERROR
2018-08-17 04:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3008  13 58347 15303578 A  ERRORERROR'
2018-08-17 04:15:03 [DEBUG   ] Got command RPT from MCS: ref #3009
2018-08-17 04:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3009  77 58347 15303578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:15:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:15:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:15:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:15:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:15:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:15:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:15:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:15:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:15:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:15:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:15:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:15:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:15:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 04:15:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 04:15:47 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-08-17 04:15:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:16:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 04:16:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:16:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:16:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:16:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:16:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:16:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:16:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:16:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:16:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:16:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:16:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:16:47 [DEBUG   ] Finished updating board flags in 1.661 seconds
2018-08-17 04:16:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:17:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 04:17:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:17:34 [DEBUG   ] Got command RPT from MCS: ref #3028
2018-08-17 04:17:34 [DEBUG   ] summary = ERROR
2018-08-17 04:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3028  13 58347 15454601 A  ERRORERROR'
2018-08-17 04:17:34 [DEBUG   ] Got command RPT from MCS: ref #3030
2018-08-17 04:17:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3030  77 58347 15454805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:17:34 [DEBUG   ] Got command RPT from MCS: ref #3031
2018-08-17 04:17:34 [DEBUG   ] summary = ERROR
2018-08-17 04:17:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3031  13 58347 15454997 A  ERRORERROR'
2018-08-17 04:17:35 [DEBUG   ] Got command RPT from MCS: ref #3032
2018-08-17 04:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3032  77 58347 15455201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:17:35 [DEBUG   ] Got command RPT from MCS: ref #3033
2018-08-17 04:17:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3033  12 58347 15455405 A  ERRORB—™š'
2018-08-17 04:17:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:17:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:17:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:17:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:17:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:17:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:17:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:17:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:17:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:17:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:17:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 04:17:47 [DEBUG   ] Finished updating board flags in 1.543 seconds
2018-08-17 04:17:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:18:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:18:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:18:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:18:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:18:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:18:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:18:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:18:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:18:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:18:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:18:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:18:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:18:47 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-08-17 04:18:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 04:19:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:19:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:19:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:19:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:19:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:19:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:19:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:19:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:19:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:19:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:19:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:19:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:19:47 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-08-17 04:19:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:20:03 [DEBUG   ] Got command RPT from MCS: ref #3034
2018-08-17 04:20:03 [DEBUG   ] summary = ERROR
2018-08-17 04:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3034  13 58347 15603581 A  ERRORERROR'
2018-08-17 04:20:03 [DEBUG   ] Got command RPT from MCS: ref #3035
2018-08-17 04:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3035  77 58347 15603582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:20:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 04:20:31 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 04:20:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:20:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:20:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:20:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:20:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:20:48 [DEBUG   ] Finished updating board flags in 2.190 seconds
2018-08-17 04:20:51 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 04:21:12 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 04:21:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 04:21:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:21:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:21:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:21:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:21:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:21:48 [DEBUG   ] Finished updating board flags in 1.939 seconds
2018-08-17 04:21:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:22:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 04:22:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 04:22:34 [DEBUG   ] Got command RPT from MCS: ref #3057
2018-08-17 04:22:34 [DEBUG   ] summary = ERROR
2018-08-17 04:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3057  13 58347 15754681 A  ERRORERROR'
2018-08-17 04:22:34 [DEBUG   ] Got command RPT from MCS: ref #3058
2018-08-17 04:22:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:22:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3058  77 58347 15754885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:22:35 [DEBUG   ] Got command RPT from MCS: ref #3059
2018-08-17 04:22:35 [DEBUG   ] summary = ERROR
2018-08-17 04:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3059  13 58347 15755089 A  ERRORERROR'
2018-08-17 04:22:35 [DEBUG   ] Got command RPT from MCS: ref #3060
2018-08-17 04:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3060  77 58347 15755281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:22:35 [DEBUG   ] Got command RPT from MCS: ref #3061
2018-08-17 04:22:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3061  12 58347 15755485 A  ERRORB—™š'
2018-08-17 04:22:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:22:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:22:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:22:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:22:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:22:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:22:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 04:22:48 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-17 04:22:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 04:23:12 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2018-08-17 04:23:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 04:23:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:23:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:23:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:23:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:23:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:23:48 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-08-17 04:23:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 04:24:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 04:24:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 04:24:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:24:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:24:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:24:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:24:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:24:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:24:48 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-08-17 04:24:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 04:25:03 [DEBUG   ] Got command RPT from MCS: ref #3071
2018-08-17 04:25:03 [DEBUG   ] summary = ERROR
2018-08-17 04:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3071  13 58347 15903578 A  ERRORERROR'
2018-08-17 04:25:03 [DEBUG   ] Got command RPT from MCS: ref #3072
2018-08-17 04:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3072  77 58347 15903578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:25:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 04:25:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:25:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:25:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:25:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:25:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:25:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:25:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:25:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:25:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:25:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:25:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:25:48 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-08-17 04:25:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:26:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 04:26:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 04:26:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:26:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:26:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:26:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:26:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:26:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:26:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:26:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:26:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:26:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:26:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-08-17 04:26:48 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-08-17 04:26:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:27:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:27:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:27:34 [DEBUG   ] Got command RPT from MCS: ref #3092
2018-08-17 04:27:34 [DEBUG   ] summary = ERROR
2018-08-17 04:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3092  13 58347 16054769 A  ERRORERROR'
2018-08-17 04:27:34 [DEBUG   ] Got command RPT from MCS: ref #3093
2018-08-17 04:27:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:27:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3093  77 58347 16054973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:27:35 [DEBUG   ] Got command RPT from MCS: ref #3094
2018-08-17 04:27:35 [DEBUG   ] summary = ERROR
2018-08-17 04:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3094  13 58347 16055165 A  ERRORERROR'
2018-08-17 04:27:35 [DEBUG   ] Got command RPT from MCS: ref #3095
2018-08-17 04:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3095  77 58347 16055369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:27:35 [DEBUG   ] Got command RPT from MCS: ref #3096
2018-08-17 04:27:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3096  12 58347 16055573 A  ERRORB—™š'
2018-08-17 04:27:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:27:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:27:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:27:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:27:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:27:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:27:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:27:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:27:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:27:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:27:48 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-08-17 04:27:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 04:28:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:28:32 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 04:28:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:28:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:28:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:28:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:28:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:28:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:28:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:28:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:28:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:28:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:28:48 [DEBUG   ] Finished updating board flags in 1.479 seconds
2018-08-17 04:28:53 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-17 04:29:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 04:29:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:29:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:29:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:29:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:29:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:29:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:29:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:29:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:29:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:29:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:29:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:29:48 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-08-17 04:29:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 04:30:03 [DEBUG   ] Got command RPT from MCS: ref #3101
2018-08-17 04:30:03 [DEBUG   ] summary = ERROR
2018-08-17 04:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3101  13 58347 16203578 A  ERRORERROR'
2018-08-17 04:30:03 [DEBUG   ] Got command RPT from MCS: ref #3102
2018-08-17 04:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3102  77 58347 16203578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:30:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 04:30:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:30:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:30:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:30:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:30:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:30:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:30:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:30:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:30:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:30:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:30:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:30:49 [DEBUG   ] Finished updating board flags in 2.311 seconds
2018-08-17 04:30:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 04:31:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 04:31:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 04:31:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:31:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:31:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:31:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:31:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:31:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:31:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:31:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:31:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:31:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:31:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 04:31:49 [DEBUG   ] Finished updating board flags in 2.091 seconds
2018-08-17 04:31:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:32:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:32:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 04:32:34 [DEBUG   ] Got command RPT from MCS: ref #3123
2018-08-17 04:32:34 [DEBUG   ] summary = ERROR
2018-08-17 04:32:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3123  13 58347 16354853 A  ERRORERROR'
2018-08-17 04:32:35 [DEBUG   ] Got command RPT from MCS: ref #3125
2018-08-17 04:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3125  77 58347 16355057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:32:35 [DEBUG   ] Got command RPT from MCS: ref #3126
2018-08-17 04:32:35 [DEBUG   ] summary = ERROR
2018-08-17 04:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3126  13 58347 16355249 A  ERRORERROR'
2018-08-17 04:32:35 [DEBUG   ] Got command RPT from MCS: ref #3127
2018-08-17 04:32:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3127  77 58347 16355453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:32:35 [DEBUG   ] Got command RPT from MCS: ref #3128
2018-08-17 04:32:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3128  12 58347 16355657 A  ERRORB—™š'
2018-08-17 04:32:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:32:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:32:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:32:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:32:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:32:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:32:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:32:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:32:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:32:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:32:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:32:49 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-08-17 04:32:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 04:33:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:33:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:33:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:33:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:33:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:33:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:33:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:33:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:33:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:33:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:33:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:33:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:33:49 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-08-17 04:33:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 04:34:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 04:34:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 04:34:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:34:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:34:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:34:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:34:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:34:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:34:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:34:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:34:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:34:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:34:49 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-08-17 04:34:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 04:35:03 [DEBUG   ] Got command RPT from MCS: ref #3134
2018-08-17 04:35:03 [DEBUG   ] summary = ERROR
2018-08-17 04:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3134  13 58347 16503585 A  ERRORERROR'
2018-08-17 04:35:03 [DEBUG   ] Got command RPT from MCS: ref #3135
2018-08-17 04:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3135  77 58347 16503586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:35:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 04:35:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 04:35:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:35:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:35:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:35:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:35:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:35:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:35:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:35:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:35:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:35:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:35:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 04:35:49 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-08-17 04:35:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 04:36:13 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 04:36:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 04:36:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:36:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:36:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:36:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:36:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:36:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:36:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:36:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:36:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:36:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:36:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 04:36:49 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-17 04:36:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 04:37:13 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 04:37:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:37:34 [DEBUG   ] Got command RPT from MCS: ref #3155
2018-08-17 04:37:34 [DEBUG   ] summary = ERROR
2018-08-17 04:37:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3155  13 58347 16654937 A  ERRORERROR'
2018-08-17 04:37:35 [DEBUG   ] Got command RPT from MCS: ref #3156
2018-08-17 04:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3156  77 58347 16655141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:37:35 [DEBUG   ] Got command RPT from MCS: ref #3157
2018-08-17 04:37:35 [DEBUG   ] summary = ERROR
2018-08-17 04:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3157  13 58347 16655333 A  ERRORERROR'
2018-08-17 04:37:35 [DEBUG   ] Got command RPT from MCS: ref #3158
2018-08-17 04:37:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3158  77 58347 16655537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:37:35 [DEBUG   ] Got command RPT from MCS: ref #3159
2018-08-17 04:37:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3159  12 58347 16655741 A  ERRORB—™š'
2018-08-17 04:37:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:37:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:37:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:37:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:37:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:37:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:37:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:37:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:37:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:37:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:37:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 04:37:49 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-17 04:37:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:38:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 04:38:33 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 04:38:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:38:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:38:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:38:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:38:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:38:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:38:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:38:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:38:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:38:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:38:49 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-08-17 04:38:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 04:39:14 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 04:39:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 04:39:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:39:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:39:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:39:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:39:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:39:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:39:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:39:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:39:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:39:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:39:49 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-08-17 04:39:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:40:03 [DEBUG   ] Got command RPT from MCS: ref #3164
2018-08-17 04:40:03 [DEBUG   ] summary = ERROR
2018-08-17 04:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3164  13 58347 16803590 A  ERRORERROR'
2018-08-17 04:40:03 [DEBUG   ] Got command RPT from MCS: ref #3165
2018-08-17 04:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3165  77 58347 16803590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:40:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 04:40:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 04:40:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:40:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:40:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:40:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:40:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:40:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:40:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:40:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:40:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:40:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:40:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 04:40:49 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-08-17 04:40:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 04:41:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 04:41:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 04:41:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:41:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:41:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:41:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:41:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:41:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:41:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:41:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:41:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:41:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:41:49 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-08-17 04:41:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 04:42:14 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-17 04:42:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 04:42:35 [DEBUG   ] Got command RPT from MCS: ref #3187
2018-08-17 04:42:35 [DEBUG   ] summary = ERROR
2018-08-17 04:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3187  13 58347 16955017 A  ERRORERROR'
2018-08-17 04:42:35 [DEBUG   ] Got command RPT from MCS: ref #3188
2018-08-17 04:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3188  77 58347 16955221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:42:35 [DEBUG   ] Got command RPT from MCS: ref #3189
2018-08-17 04:42:35 [DEBUG   ] summary = ERROR
2018-08-17 04:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3189  13 58347 16955425 A  ERRORERROR'
2018-08-17 04:42:35 [DEBUG   ] Got command RPT from MCS: ref #3190
2018-08-17 04:42:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3190  77 58347 16955629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:42:35 [DEBUG   ] Got command RPT from MCS: ref #3191
2018-08-17 04:42:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:42:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3191  12 58347 16955821 A  ERRORB˜™š'
2018-08-17 04:42:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:42:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:42:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:42:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:42:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:42:50 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-08-17 04:42:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 04:43:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:43:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:43:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:43:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:43:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:43:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:43:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:43:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:43:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:43:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:43:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:43:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:43:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:43:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 04:43:50 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-08-17 04:43:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:44:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 04:44:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:44:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:44:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:44:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:44:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:44:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:44:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:44:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:44:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:44:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:44:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:44:50 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-08-17 04:44:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 04:45:03 [DEBUG   ] Got command RPT from MCS: ref #3201
2018-08-17 04:45:03 [DEBUG   ] summary = ERROR
2018-08-17 04:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3201  13 58347 17103581 A  ERRORERROR'
2018-08-17 04:45:03 [DEBUG   ] Got command RPT from MCS: ref #3202
2018-08-17 04:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3202  77 58347 17103582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:45:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:45:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 04:45:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:45:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:45:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:45:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:45:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:45:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:45:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:45:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:45:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:45:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:45:50 [DEBUG   ] Finished updating board flags in 1.903 seconds
2018-08-17 04:45:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:46:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 04:46:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:46:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:46:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:46:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:46:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:46:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:46:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:46:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:46:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:46:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:46:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:46:50 [DEBUG   ] Finished updating board flags in 1.695 seconds
2018-08-17 04:46:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 04:47:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:47:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:47:35 [DEBUG   ] Got command RPT from MCS: ref #3221
2018-08-17 04:47:35 [DEBUG   ] summary = ERROR
2018-08-17 04:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3221  13 58347 17255105 A  ERRORERROR'
2018-08-17 04:47:35 [DEBUG   ] Got command RPT from MCS: ref #3223
2018-08-17 04:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3223  77 58347 17255309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:47:35 [DEBUG   ] Got command RPT from MCS: ref #3224
2018-08-17 04:47:35 [DEBUG   ] summary = ERROR
2018-08-17 04:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3224  13 58347 17255501 A  ERRORERROR'
2018-08-17 04:47:35 [DEBUG   ] Got command RPT from MCS: ref #3225
2018-08-17 04:47:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3225  77 58347 17255705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:47:35 [DEBUG   ] Got command RPT from MCS: ref #3226
2018-08-17 04:47:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:47:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3226  12 58347 17255910 A  ERRORB—™š'
2018-08-17 04:47:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:47:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:47:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:47:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:47:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:47:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:47:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:47:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:47:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:47:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:47:50 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-08-17 04:47:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:48:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 04:48:35 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 04:48:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:48:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:48:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:48:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:48:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:48:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:48:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:48:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:48:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:48:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:48:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 04:48:50 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-08-17 04:48:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 04:49:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 04:49:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 04:49:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:49:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:49:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:49:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:49:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:49:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:49:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:49:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:49:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:49:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:49:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:49:50 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-17 04:49:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:50:03 [DEBUG   ] Got command RPT from MCS: ref #3227
2018-08-17 04:50:03 [DEBUG   ] summary = ERROR
2018-08-17 04:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3227  13 58347 17403593 A  ERRORERROR'
2018-08-17 04:50:03 [DEBUG   ] Got command RPT from MCS: ref #3228
2018-08-17 04:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3228  77 58347 17403594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:50:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 04:50:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 04:50:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:50:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:50:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:50:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:50:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:50:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:50:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:50:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:50:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:50:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:50:50 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-08-17 04:50:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 04:51:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:51:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 04:51:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:51:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:51:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:51:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:51:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:51:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:51:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:51:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:51:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:51:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:51:50 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-08-17 04:51:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 04:52:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 04:52:35 [DEBUG   ] Got command RPT from MCS: ref #3250
2018-08-17 04:52:35 [DEBUG   ] summary = ERROR
2018-08-17 04:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3250  13 58347 17555186 A  ERRORERROR'
2018-08-17 04:52:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 04:52:35 [DEBUG   ] Got command RPT from MCS: ref #3251
2018-08-17 04:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3251  77 58347 17555389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:52:35 [DEBUG   ] Got command RPT from MCS: ref #3252
2018-08-17 04:52:35 [DEBUG   ] summary = ERROR
2018-08-17 04:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3252  13 58347 17555593 A  ERRORERROR'
2018-08-17 04:52:35 [DEBUG   ] Got command RPT from MCS: ref #3253
2018-08-17 04:52:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3253  77 58347 17555797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:52:35 [DEBUG   ] Got command RPT from MCS: ref #3254
2018-08-17 04:52:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:52:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3254  12 58347 17555989 A  ERRORB—™š'
2018-08-17 04:52:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:52:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:52:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:52:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:52:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:52:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:52:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:52:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:52:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:52:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:52:51 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-17 04:52:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 04:53:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 04:53:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 04:53:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:53:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:53:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:53:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:53:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:53:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:53:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:53:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:53:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:53:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:53:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:53:51 [DEBUG   ] Finished updating board flags in 2.143 seconds
2018-08-17 04:53:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 04:54:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 04:54:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 04:54:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:54:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:54:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:54:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:54:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:54:50 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:54:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:54:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:54:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:54:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:54:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:54:51 [DEBUG   ] Finished updating board flags in 1.879 seconds
2018-08-17 04:54:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 04:55:03 [DEBUG   ] Got command RPT from MCS: ref #3264
2018-08-17 04:55:03 [DEBUG   ] summary = ERROR
2018-08-17 04:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3264  13 58347 17703585 A  ERRORERROR'
2018-08-17 04:55:03 [DEBUG   ] Got command RPT from MCS: ref #3265
2018-08-17 04:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3265  77 58347 17703586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:55:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 04:55:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 04:55:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:55:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:55:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:55:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:55:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:55:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:55:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:55:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:55:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:55:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:55:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:55:51 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-08-17 04:55:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 04:56:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 04:56:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 04:56:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:56:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:56:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:56:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:56:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:56:50 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:56:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:56:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:56:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:56:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:56:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:56:51 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-17 04:56:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 04:57:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 04:57:35 [DEBUG   ] Got command RPT from MCS: ref #3285
2018-08-17 04:57:35 [DEBUG   ] summary = ERROR
2018-08-17 04:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3285  13 58347 17855273 A  ERRORERROR'
2018-08-17 04:57:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:57:35 [DEBUG   ] Got command RPT from MCS: ref #3286
2018-08-17 04:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3286  77 58347 17855477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:57:35 [DEBUG   ] Got command RPT from MCS: ref #3287
2018-08-17 04:57:35 [DEBUG   ] summary = ERROR
2018-08-17 04:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3287  13 58347 17855681 A  ERRORERROR'
2018-08-17 04:57:35 [DEBUG   ] Got command RPT from MCS: ref #3288
2018-08-17 04:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 04:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3288  77 58347 17855873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 04:57:36 [DEBUG   ] Got command RPT from MCS: ref #3289
2018-08-17 04:57:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 04:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3289  12 58347 17856077 A  ERRORB—™š'
2018-08-17 04:57:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:57:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:57:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:57:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:57:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:57:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:57:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:57:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:57:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:57:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:57:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:57:51 [DEBUG   ] Finished updating board flags in 1.763 seconds
2018-08-17 04:57:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:58:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 04:58:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:58:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:58:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:58:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:58:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:58:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:58:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 04:58:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:58:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:58:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:58:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:58:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:58:51 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-08-17 04:58:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 04:59:15 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 04:59:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 04:59:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 04:59:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 04:59:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 04:59:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 04:59:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 04:59:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 04:59:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 04:59:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 04:59:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 04:59:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 04:59:51 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-08-17 04:59:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 05:00:03 [DEBUG   ] Got command RPT from MCS: ref #3294
2018-08-17 05:00:03 [DEBUG   ] summary = ERROR
2018-08-17 05:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3294  13 58347 18003589 A  ERRORERROR'
2018-08-17 05:00:03 [DEBUG   ] Got command RPT from MCS: ref #3295
2018-08-17 05:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3295  77 58347 18003590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:00:16 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-17 05:00:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 05:00:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:00:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:00:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:00:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:00:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:00:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:00:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:00:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:00:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:00:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:00:51 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-08-17 05:00:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 05:01:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 05:01:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 05:01:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:01:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:01:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:01:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:01:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:01:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:01:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:01:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:01:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:01:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:01:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 05:01:51 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-08-17 05:01:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 05:02:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 05:02:35 [DEBUG   ] Got command RPT from MCS: ref #3316
2018-08-17 05:02:35 [DEBUG   ] summary = ERROR
2018-08-17 05:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3316  13 58347 18155365 A  ERRORERROR'
2018-08-17 05:02:35 [DEBUG   ] Got command RPT from MCS: ref #3318
2018-08-17 05:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3318  77 58347 18155558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:02:35 [DEBUG   ] Got command RPT from MCS: ref #3319
2018-08-17 05:02:35 [DEBUG   ] summary = ERROR
2018-08-17 05:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3319  13 58347 18155761 A  ERRORERROR'
2018-08-17 05:02:35 [DEBUG   ] Got command RPT from MCS: ref #3320
2018-08-17 05:02:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3320  77 58347 18155965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:02:36 [DEBUG   ] Got command RPT from MCS: ref #3321
2018-08-17 05:02:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3321  12 58347 18156169 A  ERRORB—™š'
2018-08-17 05:02:36 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 05:02:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:02:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:02:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:02:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:02:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:02:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:02:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:02:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:02:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:02:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:02:51 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-08-17 05:02:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 05:03:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 05:03:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 05:03:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:03:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:03:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:03:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:03:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:03:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 05:03:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:03:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:03:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:03:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:03:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:03:51 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-08-17 05:03:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 05:04:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 05:04:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 05:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:04:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:04:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 05:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:04:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:04:51 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-17 05:04:56 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-08-17 05:05:03 [DEBUG   ] Got command RPT from MCS: ref #3327
2018-08-17 05:05:03 [DEBUG   ] summary = ERROR
2018-08-17 05:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3327  13 58347 18303586 A  ERRORERROR'
2018-08-17 05:05:03 [DEBUG   ] Got command RPT from MCS: ref #3328
2018-08-17 05:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3328  77 58347 18303586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:05:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 05:05:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 05:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:05:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:05:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:05:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:05:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:05:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:05:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:05:52 [DEBUG   ] Finished updating board flags in 2.238 seconds
2018-08-17 05:05:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 05:06:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 05:06:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 05:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:06:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:06:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:06:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:06:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:06:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:06:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:06:52 [DEBUG   ] Finished updating board flags in 2.148 seconds
2018-08-17 05:06:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 05:07:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 05:07:35 [DEBUG   ] Got command RPT from MCS: ref #3348
2018-08-17 05:07:35 [DEBUG   ] summary = ERROR
2018-08-17 05:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3348  13 58347 18455453 A  ERRORERROR'
2018-08-17 05:07:35 [DEBUG   ] Got command RPT from MCS: ref #3349
2018-08-17 05:07:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3349  77 58347 18455645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:07:35 [DEBUG   ] Got command RPT from MCS: ref #3350
2018-08-17 05:07:35 [DEBUG   ] summary = ERROR
2018-08-17 05:07:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3350  13 58347 18455849 A  ERRORERROR'
2018-08-17 05:07:36 [DEBUG   ] Got command RPT from MCS: ref #3351
2018-08-17 05:07:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3351  77 58347 18456053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:07:36 [DEBUG   ] Got command RPT from MCS: ref #3352
2018-08-17 05:07:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3352  12 58347 18456258 A  ERRORB˜™š'
2018-08-17 05:07:37 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-17 05:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:07:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:07:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:07:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:07:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:07:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:07:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:07:52 [DEBUG   ] Finished updating board flags in 2.033 seconds
2018-08-17 05:07:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 05:08:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 05:08:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 05:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:08:52 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-08-17 05:08:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 05:09:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 05:09:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 05:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:09:52 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-08-17 05:09:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 05:10:03 [DEBUG   ] Got command RPT from MCS: ref #3357
2018-08-17 05:10:03 [DEBUG   ] summary = ERROR
2018-08-17 05:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3357  13 58347 18603597 A  ERRORERROR'
2018-08-17 05:10:03 [DEBUG   ] Got command RPT from MCS: ref #3358
2018-08-17 05:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3358  77 58347 18603598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:10:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 05:10:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 05:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:10:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:10:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:10:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:10:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:10:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:10:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:10:52 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-08-17 05:10:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 05:11:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 05:11:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 05:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:11:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:11:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-08-17 05:11:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:11:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:11:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:11:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:11:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:11:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-08-17 05:11:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 05:11:52 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-08-17 05:11:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 05:12:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 05:12:35 [DEBUG   ] Got command RPT from MCS: ref #3380
2018-08-17 05:12:35 [DEBUG   ] summary = ERROR
2018-08-17 05:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3380  13 58347 18755537 A  ERRORERROR'
2018-08-17 05:12:35 [DEBUG   ] Got command RPT from MCS: ref #3381
2018-08-17 05:12:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3381  77 58347 18755729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:12:35 [DEBUG   ] Got command RPT from MCS: ref #3382
2018-08-17 05:12:35 [DEBUG   ] summary = ERROR
2018-08-17 05:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3382  13 58347 18755933 A  ERRORERROR'
2018-08-17 05:12:36 [DEBUG   ] Got command RPT from MCS: ref #3383
2018-08-17 05:12:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3383  77 58347 18756137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:12:36 [DEBUG   ] Got command RPT from MCS: ref #3384
2018-08-17 05:12:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3384  12 58347 18756341 A  ERRORB˜™š'
2018-08-17 05:12:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 05:12:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:12:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:12:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:12:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:12:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:12:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-08-17 05:12:52 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-08-17 05:12:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 05:13:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 05:13:38 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 05:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:13:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:13:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:13:52 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-08-17 05:13:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 05:14:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 05:14:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 05:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:14:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:14:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:14:52 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-08-17 05:14:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 05:15:03 [DEBUG   ] Got command RPT from MCS: ref #3394
2018-08-17 05:15:03 [DEBUG   ] summary = ERROR
2018-08-17 05:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3394  13 58347 18903597 A  ERRORERROR'
2018-08-17 05:15:03 [DEBUG   ] Got command RPT from MCS: ref #3395
2018-08-17 05:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3395  77 58347 18903598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:15:18 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-17 05:15:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 05:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:15:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:15:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:15:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:15:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:15:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:15:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:15:52 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-08-17 05:15:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 05:16:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 05:16:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 05:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:16:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:16:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:16:52 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-08-17 05:16:58 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 05:17:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 05:17:35 [DEBUG   ] Got command RPT from MCS: ref #3414
2018-08-17 05:17:35 [DEBUG   ] summary = ERROR
2018-08-17 05:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3414  13 58347 19055617 A  ERRORERROR'
2018-08-17 05:17:35 [DEBUG   ] Got command RPT from MCS: ref #3416
2018-08-17 05:17:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3416  77 58347 19055821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:17:36 [DEBUG   ] Got command RPT from MCS: ref #3417
2018-08-17 05:17:36 [DEBUG   ] summary = ERROR
2018-08-17 05:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3417  13 58347 19056013 A  ERRORERROR'
2018-08-17 05:17:36 [DEBUG   ] Got command RPT from MCS: ref #3418
2018-08-17 05:17:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3418  77 58347 19056217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:17:36 [DEBUG   ] Got command RPT from MCS: ref #3419
2018-08-17 05:17:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3419  12 58347 19056421 A  ERRORB—™š'
2018-08-17 05:17:39 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-17 05:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:17:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:17:53 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-08-17 05:17:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 05:18:18 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 05:18:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 05:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:18:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:18:53 [DEBUG   ] Finished updating board flags in 2.046 seconds
2018-08-17 05:18:59 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-17 05:19:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 05:19:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 05:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:19:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:19:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:19:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:19:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:19:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:19:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:19:53 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-08-17 05:19:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 05:20:03 [DEBUG   ] Got command RPT from MCS: ref #3420
2018-08-17 05:20:03 [DEBUG   ] summary = ERROR
2018-08-17 05:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3420  13 58347 19203593 A  ERRORERROR'
2018-08-17 05:20:03 [DEBUG   ] Got command RPT from MCS: ref #3421
2018-08-17 05:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3421  77 58347 19203594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:20:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 05:20:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 05:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:20:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:20:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:20:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:20:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:20:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:20:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:20:53 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-08-17 05:20:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 05:21:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 05:21:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 05:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:21:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:21:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:21:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:21:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:21:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:21:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:21:53 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-08-17 05:21:59 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 05:22:19 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 05:22:35 [DEBUG   ] Got command RPT from MCS: ref #3443
2018-08-17 05:22:35 [DEBUG   ] summary = ERROR
2018-08-17 05:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3443  13 58347 19355701 A  ERRORERROR'
2018-08-17 05:22:35 [DEBUG   ] Got command RPT from MCS: ref #3444
2018-08-17 05:22:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:22:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3444  77 58347 19355905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:22:36 [DEBUG   ] Got command RPT from MCS: ref #3445
2018-08-17 05:22:36 [DEBUG   ] summary = ERROR
2018-08-17 05:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3445  13 58347 19356097 A  ERRORERROR'
2018-08-17 05:22:36 [DEBUG   ] Got command RPT from MCS: ref #3446
2018-08-17 05:22:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3446  77 58347 19356301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:22:36 [DEBUG   ] Got command RPT from MCS: ref #3447
2018-08-17 05:22:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3447  12 58347 19356505 A  ERRORB•™š'
2018-08-17 05:22:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 05:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:22:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:22:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:22:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:22:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:22:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:22:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:22:53 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-08-17 05:23:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 05:23:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 05:23:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 05:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:23:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:23:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:23:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:23:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:23:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:23:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:23:53 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-08-17 05:24:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 05:24:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 05:24:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 05:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:24:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:24:53 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-08-17 05:25:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 05:25:03 [DEBUG   ] Got command RPT from MCS: ref #3457
2018-08-17 05:25:03 [DEBUG   ] summary = ERROR
2018-08-17 05:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3457  13 58347 19503597 A  ERRORERROR'
2018-08-17 05:25:03 [DEBUG   ] Got command RPT from MCS: ref #3458
2018-08-17 05:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3458  77 58347 19503598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:25:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 05:25:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 05:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:25:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:25:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:25:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:25:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:25:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:25:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:25:53 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-08-17 05:26:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 05:26:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 05:26:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 05:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:26:53 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-08-17 05:27:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 05:27:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 05:27:35 [DEBUG   ] Got command RPT from MCS: ref #3478
2018-08-17 05:27:35 [DEBUG   ] summary = ERROR
2018-08-17 05:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3478  13 58347 19655785 A  ERRORERROR'
2018-08-17 05:27:35 [DEBUG   ] Got command RPT from MCS: ref #3479
2018-08-17 05:27:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:27:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3479  77 58347 19655989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:27:36 [DEBUG   ] Got command RPT from MCS: ref #3480
2018-08-17 05:27:36 [DEBUG   ] summary = ERROR
2018-08-17 05:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3480  13 58347 19656181 A  ERRORERROR'
2018-08-17 05:27:36 [DEBUG   ] Got command RPT from MCS: ref #3481
2018-08-17 05:27:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3481  77 58347 19656385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:27:36 [DEBUG   ] Got command RPT from MCS: ref #3482
2018-08-17 05:27:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3482  12 58347 19656589 A  ERRORB”™š'
2018-08-17 05:27:40 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 05:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:27:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:27:53 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-08-17 05:28:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 05:28:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 05:28:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 05:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:28:53 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-08-17 05:29:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 05:29:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 05:29:40 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 05:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:29:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:29:53 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-08-17 05:30:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 05:30:03 [DEBUG   ] Got command RPT from MCS: ref #3487
2018-08-17 05:30:03 [DEBUG   ] summary = ERROR
2018-08-17 05:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3487  13 58347 19803593 A  ERRORERROR'
2018-08-17 05:30:03 [DEBUG   ] Got command RPT from MCS: ref #3488
2018-08-17 05:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3488  77 58347 19803594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:30:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 05:30:40 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 05:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:30:53 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-08-17 05:31:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 05:31:21 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 05:31:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 05:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:31:53 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-08-17 05:32:01 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 05:32:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 05:32:35 [DEBUG   ] Got command RPT from MCS: ref #3509
2018-08-17 05:32:35 [DEBUG   ] summary = ERROR
2018-08-17 05:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3509  13 58347 19955865 A  ERRORERROR'
2018-08-17 05:32:36 [DEBUG   ] Got command RPT from MCS: ref #3511
2018-08-17 05:32:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3511  77 58347 19956069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:32:36 [DEBUG   ] Got command RPT from MCS: ref #3512
2018-08-17 05:32:36 [DEBUG   ] summary = ERROR
2018-08-17 05:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3512  13 58347 19956273 A  ERRORERROR'
2018-08-17 05:32:36 [DEBUG   ] Got command RPT from MCS: ref #3513
2018-08-17 05:32:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3513  77 58347 19956465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:32:36 [DEBUG   ] Got command RPT from MCS: ref #3514
2018-08-17 05:32:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3514  12 58347 19956669 A  ERRORB“™š'
2018-08-17 05:32:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 05:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:32:53 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-08-17 05:33:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 05:33:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 05:33:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 05:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:33:54 [DEBUG   ] Finished updating board flags in 2.273 seconds
2018-08-17 05:34:01 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 05:34:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 05:34:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 05:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:34:54 [DEBUG   ] Finished updating board flags in 2.072 seconds
2018-08-17 05:35:02 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-17 05:35:03 [DEBUG   ] Got command RPT from MCS: ref #3520
2018-08-17 05:35:03 [DEBUG   ] summary = ERROR
2018-08-17 05:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3520  13 58347 20103597 A  ERRORERROR'
2018-08-17 05:35:03 [DEBUG   ] Got command RPT from MCS: ref #3521
2018-08-17 05:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3521  77 58347 20103598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:35:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 05:35:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 05:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:35:54 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-08-17 05:36:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 05:36:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 05:36:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 05:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:36:54 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-08-17 05:37:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 05:37:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 05:37:35 [DEBUG   ] Got command RPT from MCS: ref #3541
2018-08-17 05:37:35 [DEBUG   ] summary = ERROR
2018-08-17 05:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3541  13 58347 20255950 A  ERRORERROR'
2018-08-17 05:37:36 [DEBUG   ] Got command RPT from MCS: ref #3542
2018-08-17 05:37:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3542  77 58347 20256153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:37:36 [DEBUG   ] Got command RPT from MCS: ref #3543
2018-08-17 05:37:36 [DEBUG   ] summary = ERROR
2018-08-17 05:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3543  13 58347 20256357 A  ERRORERROR'
2018-08-17 05:37:36 [DEBUG   ] Got command RPT from MCS: ref #3544
2018-08-17 05:37:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3544  77 58347 20256550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:37:36 [DEBUG   ] Got command RPT from MCS: ref #3545
2018-08-17 05:37:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3545  12 58347 20256754 A  ERRORB“™š'
2018-08-17 05:37:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 05:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:37:54 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-17 05:38:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 05:38:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 05:38:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 05:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:38:54 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-08-17 05:39:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 05:39:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 05:39:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 05:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:39:54 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-08-17 05:40:03 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 05:40:03 [DEBUG   ] Got command RPT from MCS: ref #3550
2018-08-17 05:40:03 [DEBUG   ] summary = ERROR
2018-08-17 05:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3550  13 58347 20403605 A  ERRORERROR'
2018-08-17 05:40:03 [DEBUG   ] Got command RPT from MCS: ref #3551
2018-08-17 05:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3551  77 58347 20403606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:40:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 05:40:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 05:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 05:40:54 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-08-17 05:41:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 05:41:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 05:41:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 05:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 05:41:54 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-08-17 05:42:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 05:42:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 05:42:36 [DEBUG   ] Got command RPT from MCS: ref #3573
2018-08-17 05:42:36 [DEBUG   ] summary = ERROR
2018-08-17 05:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3573  13 58347 20556033 A  ERRORERROR'
2018-08-17 05:42:36 [DEBUG   ] Got command RPT from MCS: ref #3574
2018-08-17 05:42:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3574  77 58347 20556237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:42:36 [DEBUG   ] Got command RPT from MCS: ref #3575
2018-08-17 05:42:36 [DEBUG   ] summary = ERROR
2018-08-17 05:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3575  13 58347 20556441 A  ERRORERROR'
2018-08-17 05:42:36 [DEBUG   ] Got command RPT from MCS: ref #3576
2018-08-17 05:42:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3576  77 58347 20556633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:42:36 [DEBUG   ] Got command RPT from MCS: ref #3577
2018-08-17 05:42:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3577  12 58347 20556837 A  ERRORB“™š'
2018-08-17 05:42:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 05:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:42:54 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-08-17 05:43:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 05:43:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 05:43:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 05:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:43:54 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-08-17 05:44:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 05:44:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 05:44:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 05:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:44:54 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-08-17 05:45:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 05:45:03 [DEBUG   ] Got command RPT from MCS: ref #3587
2018-08-17 05:45:03 [DEBUG   ] summary = ERROR
2018-08-17 05:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3587  13 58347 20703605 A  ERRORERROR'
2018-08-17 05:45:03 [DEBUG   ] Got command RPT from MCS: ref #3588
2018-08-17 05:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3588  77 58347 20703606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:45:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 05:45:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 05:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:45:54 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-08-17 05:46:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 05:46:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 05:46:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 05:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:46:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:46:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:46:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:46:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:46:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:46:55 [DEBUG   ] Finished updating board flags in 2.175 seconds
2018-08-17 05:47:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 05:47:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 05:47:36 [DEBUG   ] Got command RPT from MCS: ref #3607
2018-08-17 05:47:36 [DEBUG   ] summary = ERROR
2018-08-17 05:47:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3607  13 58347 20856117 A  ERRORERROR'
2018-08-17 05:47:36 [DEBUG   ] Got command RPT from MCS: ref #3609
2018-08-17 05:47:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:47:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3609  77 58347 20856321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:47:36 [DEBUG   ] Got command RPT from MCS: ref #3610
2018-08-17 05:47:36 [DEBUG   ] summary = ERROR
2018-08-17 05:47:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3610  13 58347 20856525 A  ERRORERROR'
2018-08-17 05:47:36 [DEBUG   ] Got command RPT from MCS: ref #3611
2018-08-17 05:47:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:47:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3611  77 58347 20856729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:47:36 [DEBUG   ] Got command RPT from MCS: ref #3612
2018-08-17 05:47:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:47:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3612  12 58347 20856921 A  ERRORB“™š'
2018-08-17 05:47:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 05:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:47:55 [DEBUG   ] Finished updating board flags in 1.900 seconds
2018-08-17 05:48:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 05:48:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 05:48:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 05:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:48:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:48:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:48:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:48:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:48:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:48:55 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-08-17 05:49:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 05:49:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 05:49:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 05:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:49:55 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-08-17 05:50:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 05:50:03 [DEBUG   ] Got command RPT from MCS: ref #3613
2018-08-17 05:50:03 [DEBUG   ] summary = ERROR
2018-08-17 05:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3613  13 58347 21003601 A  ERRORERROR'
2018-08-17 05:50:03 [DEBUG   ] Got command RPT from MCS: ref #3614
2018-08-17 05:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3614  77 58347 21003602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:50:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 05:50:44 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 05:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:50:55 [DEBUG   ] Finished updating board flags in 1.767 seconds
2018-08-17 05:51:04 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 05:51:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 05:51:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 05:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:51:55 [DEBUG   ] Finished updating board flags in 1.678 seconds
2018-08-17 05:52:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 05:52:24 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 05:52:36 [DEBUG   ] Got command RPT from MCS: ref #3636
2018-08-17 05:52:36 [DEBUG   ] summary = ERROR
2018-08-17 05:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3636  13 58347 21156209 A  ERRORERROR'
2018-08-17 05:52:36 [DEBUG   ] Got command RPT from MCS: ref #3637
2018-08-17 05:52:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3637  77 58347 21156413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:52:36 [DEBUG   ] Got command RPT from MCS: ref #3638
2018-08-17 05:52:36 [DEBUG   ] summary = ERROR
2018-08-17 05:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3638  13 58347 21156605 A  ERRORERROR'
2018-08-17 05:52:36 [DEBUG   ] Got command RPT from MCS: ref #3639
2018-08-17 05:52:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3639  77 58347 21156809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:52:37 [DEBUG   ] Got command RPT from MCS: ref #3640
2018-08-17 05:52:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:52:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3640  12 58347 21157013 A  ERRORB”™š'
2018-08-17 05:52:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 05:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:52:55 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-08-17 05:53:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 05:53:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 05:53:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 05:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:53:55 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-08-17 05:54:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 05:54:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 05:54:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 05:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:54:55 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-08-17 05:55:03 [DEBUG   ] Got command RPT from MCS: ref #3650
2018-08-17 05:55:03 [DEBUG   ] summary = ERROR
2018-08-17 05:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3650  13 58347 21303605 A  ERRORERROR'
2018-08-17 05:55:03 [DEBUG   ] Got command RPT from MCS: ref #3651
2018-08-17 05:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3651  77 58347 21303606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:55:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 05:55:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 05:55:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 05:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:55:55 [DEBUG   ] Finished updating board flags in 1.480 seconds
2018-08-17 05:56:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 05:56:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 05:56:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 05:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:56:55 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-08-17 05:57:04 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-08-17 05:57:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 05:57:36 [DEBUG   ] Got command RPT from MCS: ref #3671
2018-08-17 05:57:36 [DEBUG   ] summary = ERROR
2018-08-17 05:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3671  13 58347 21456297 A  ERRORERROR'
2018-08-17 05:57:36 [DEBUG   ] Got command RPT from MCS: ref #3672
2018-08-17 05:57:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3672  77 58347 21456489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:57:36 [DEBUG   ] Got command RPT from MCS: ref #3673
2018-08-17 05:57:36 [DEBUG   ] summary = ERROR
2018-08-17 05:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3673  13 58347 21456693 A  ERRORERROR'
2018-08-17 05:57:36 [DEBUG   ] Got command RPT from MCS: ref #3674
2018-08-17 05:57:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 05:57:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3674  77 58347 21456897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 05:57:37 [DEBUG   ] Got command RPT from MCS: ref #3675
2018-08-17 05:57:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 05:57:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3675  12 58347 21457101 A  ERRORB“™š'
2018-08-17 05:57:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 05:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:57:56 [DEBUG   ] Finished updating board flags in 2.188 seconds
2018-08-17 05:58:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 05:58:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 05:58:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 05:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:58:56 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-08-17 05:59:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 05:59:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 05:59:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 05:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 05:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 05:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 05:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 05:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 05:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 05:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 05:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 05:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 05:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 05:59:56 [DEBUG   ] Finished updating board flags in 1.961 seconds
2018-08-17 06:00:03 [DEBUG   ] Got command RPT from MCS: ref #3680
2018-08-17 06:00:03 [DEBUG   ] summary = ERROR
2018-08-17 06:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3680  13 58347 21603609 A  ERRORERROR'
2018-08-17 06:00:03 [DEBUG   ] Got command RPT from MCS: ref #3681
2018-08-17 06:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3681  77 58347 21603610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:00:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 06:00:25 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-08-17 06:00:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 06:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:00:56 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-08-17 06:01:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 06:01:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 06:01:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 06:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:01:56 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-08-17 06:02:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 06:02:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 06:02:36 [DEBUG   ] Got command RPT from MCS: ref #3702
2018-08-17 06:02:36 [DEBUG   ] summary = ERROR
2018-08-17 06:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3702  13 58347 21756373 A  ERRORERROR'
2018-08-17 06:02:36 [DEBUG   ] Got command RPT from MCS: ref #3704
2018-08-17 06:02:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3704  77 58347 21756577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:02:36 [DEBUG   ] Got command RPT from MCS: ref #3705
2018-08-17 06:02:36 [DEBUG   ] summary = ERROR
2018-08-17 06:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3705  13 58347 21756781 A  ERRORERROR'
2018-08-17 06:02:36 [DEBUG   ] Got command RPT from MCS: ref #3706
2018-08-17 06:02:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:02:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3706  77 58347 21756985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:02:37 [DEBUG   ] Got command RPT from MCS: ref #3707
2018-08-17 06:02:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3707  12 58347 21757177 A  ERRORB“™š'
2018-08-17 06:02:46 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 06:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:02:56 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-08-17 06:03:06 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 06:03:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 06:03:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 06:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:03:56 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-17 06:04:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 06:04:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 06:04:46 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 06:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:04:56 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-17 06:05:03 [DEBUG   ] Got command RPT from MCS: ref #3713
2018-08-17 06:05:03 [DEBUG   ] summary = ERROR
2018-08-17 06:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3713  13 58347 21903601 A  ERRORERROR'
2018-08-17 06:05:03 [DEBUG   ] Got command RPT from MCS: ref #3714
2018-08-17 06:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3714  77 58347 21903602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:05:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 06:05:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 06:05:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 06:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:05:56 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-08-17 06:06:06 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 06:06:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 06:06:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 06:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:06:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 06:06:56 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-08-17 06:07:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 06:07:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 06:07:36 [DEBUG   ] Got command RPT from MCS: ref #3734
2018-08-17 06:07:36 [DEBUG   ] summary = ERROR
2018-08-17 06:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3734  13 58347 22056469 A  ERRORERROR'
2018-08-17 06:07:36 [DEBUG   ] Got command RPT from MCS: ref #3735
2018-08-17 06:07:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3735  77 58347 22056661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:07:36 [DEBUG   ] Got command RPT from MCS: ref #3736
2018-08-17 06:07:36 [DEBUG   ] summary = ERROR
2018-08-17 06:07:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3736  13 58347 22056865 A  ERRORERROR'
2018-08-17 06:07:37 [DEBUG   ] Got command RPT from MCS: ref #3737
2018-08-17 06:07:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3737  77 58347 22057069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:07:37 [DEBUG   ] Got command RPT from MCS: ref #3738
2018-08-17 06:07:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3738  12 58347 22057273 A  ERRORB”™š'
2018-08-17 06:07:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 06:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:07:57 [DEBUG   ] Finished updating board flags in 2.074 seconds
2018-08-17 06:08:07 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 06:08:27 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-17 06:08:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 06:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:08:57 [DEBUG   ] Finished updating board flags in 1.958 seconds
2018-08-17 06:09:07 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 06:09:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 06:09:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 06:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:09:57 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-08-17 06:10:03 [DEBUG   ] Got command RPT from MCS: ref #3743
2018-08-17 06:10:03 [DEBUG   ] summary = ERROR
2018-08-17 06:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3743  13 58347 22203613 A  ERRORERROR'
2018-08-17 06:10:03 [DEBUG   ] Got command RPT from MCS: ref #3744
2018-08-17 06:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3744  77 58347 22203614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:10:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 06:10:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 06:10:48 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 06:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:10:57 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-17 06:11:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 06:11:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 06:11:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 06:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:11:57 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-17 06:12:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 06:12:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 06:12:36 [DEBUG   ] Got command RPT from MCS: ref #3766
2018-08-17 06:12:36 [DEBUG   ] summary = ERROR
2018-08-17 06:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3766  13 58347 22356545 A  ERRORERROR'
2018-08-17 06:12:36 [DEBUG   ] Got command RPT from MCS: ref #3767
2018-08-17 06:12:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3767  77 58347 22356749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:12:36 [DEBUG   ] Got command RPT from MCS: ref #3768
2018-08-17 06:12:36 [DEBUG   ] summary = ERROR
2018-08-17 06:12:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3768  13 58347 22356953 A  ERRORERROR'
2018-08-17 06:12:37 [DEBUG   ] Got command RPT from MCS: ref #3769
2018-08-17 06:12:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3769  77 58347 22357157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:12:37 [DEBUG   ] Got command RPT from MCS: ref #3770
2018-08-17 06:12:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3770  12 58347 22357349 A  ERRORB“™š'
2018-08-17 06:12:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 06:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:12:57 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-08-17 06:13:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 06:13:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 06:13:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 06:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:13:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 06:13:57 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-08-17 06:14:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 06:14:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 06:14:48 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-17 06:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:14:57 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-08-17 06:15:03 [DEBUG   ] Got command RPT from MCS: ref #3780
2018-08-17 06:15:03 [DEBUG   ] summary = ERROR
2018-08-17 06:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3780  13 58347 22503609 A  ERRORERROR'
2018-08-17 06:15:03 [DEBUG   ] Got command RPT from MCS: ref #3781
2018-08-17 06:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3781  77 58347 22503610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:15:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 06:15:28 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-08-17 06:15:49 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2018-08-17 06:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:15:58 [DEBUG   ] Finished updating board flags in 2.170 seconds
2018-08-17 06:16:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 06:16:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 06:16:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 06:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 06:16:58 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-08-17 06:17:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 06:17:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 06:17:36 [DEBUG   ] Got command RPT from MCS: ref #3800
2018-08-17 06:17:36 [DEBUG   ] summary = ERROR
2018-08-17 06:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3800  13 58347 22656633 A  ERRORERROR'
2018-08-17 06:17:36 [DEBUG   ] Got command RPT from MCS: ref #3802
2018-08-17 06:17:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:17:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3802  77 58347 22656837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:17:37 [DEBUG   ] Got command RPT from MCS: ref #3803
2018-08-17 06:17:37 [DEBUG   ] summary = ERROR
2018-08-17 06:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3803  13 58347 22657029 A  ERRORERROR'
2018-08-17 06:17:37 [DEBUG   ] Got command RPT from MCS: ref #3804
2018-08-17 06:17:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3804  77 58347 22657233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:17:37 [DEBUG   ] Got command RPT from MCS: ref #3805
2018-08-17 06:17:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3805  12 58347 22657437 A  ERRORB“™š'
2018-08-17 06:17:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 06:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:17:58 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-08-17 06:18:09 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 06:18:30 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 06:18:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 06:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 06:18:58 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-08-17 06:19:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 06:19:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 06:19:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 06:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:19:58 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-08-17 06:20:03 [DEBUG   ] Got command RPT from MCS: ref #3806
2018-08-17 06:20:03 [DEBUG   ] summary = ERROR
2018-08-17 06:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3806  13 58347 22803617 A  ERRORERROR'
2018-08-17 06:20:03 [DEBUG   ] Got command RPT from MCS: ref #3807
2018-08-17 06:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3807  77 58347 22803618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:20:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 06:20:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 06:20:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 06:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:20:58 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-08-17 06:21:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 06:21:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 06:21:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 06:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:21:58 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-08-17 06:22:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 06:22:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 06:22:36 [DEBUG   ] Got command RPT from MCS: ref #3829
2018-08-17 06:22:36 [DEBUG   ] summary = ERROR
2018-08-17 06:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3829  13 58347 22956721 A  ERRORERROR'
2018-08-17 06:22:36 [DEBUG   ] Got command RPT from MCS: ref #3830
2018-08-17 06:22:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:22:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3830  77 58347 22956914 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:22:37 [DEBUG   ] Got command RPT from MCS: ref #3831
2018-08-17 06:22:37 [DEBUG   ] summary = ERROR
2018-08-17 06:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3831  13 58347 22957117 A  ERRORERROR'
2018-08-17 06:22:37 [DEBUG   ] Got command RPT from MCS: ref #3832
2018-08-17 06:22:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3832  77 58347 22957321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:22:37 [DEBUG   ] Got command RPT from MCS: ref #3833
2018-08-17 06:22:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3833  12 58347 22957525 A  ERRORB“™š'
2018-08-17 06:22:51 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 06:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:22:58 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-08-17 06:23:10 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-17 06:23:31 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-17 06:23:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 06:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:23:58 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-08-17 06:24:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 06:24:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 06:24:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 06:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:24:58 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-08-17 06:25:03 [DEBUG   ] Got command RPT from MCS: ref #3843
2018-08-17 06:25:03 [DEBUG   ] summary = ERROR
2018-08-17 06:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3843  13 58347 23103609 A  ERRORERROR'
2018-08-17 06:25:03 [DEBUG   ] Got command RPT from MCS: ref #3844
2018-08-17 06:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3844  77 58347 23103610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:25:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 06:25:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 06:25:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 06:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:25:59 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-08-17 06:26:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 06:26:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 06:26:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 06:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:26:59 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-08-17 06:27:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 06:27:32 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 06:27:36 [DEBUG   ] Got command RPT from MCS: ref #3864
2018-08-17 06:27:36 [DEBUG   ] summary = ERROR
2018-08-17 06:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3864  13 58347 23256801 A  ERRORERROR'
2018-08-17 06:27:37 [DEBUG   ] Got command RPT from MCS: ref #3865
2018-08-17 06:27:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:27:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3865  77 58347 23257005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:27:37 [DEBUG   ] Got command RPT from MCS: ref #3866
2018-08-17 06:27:37 [DEBUG   ] summary = ERROR
2018-08-17 06:27:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3866  13 58347 23257209 A  ERRORERROR'
2018-08-17 06:27:37 [DEBUG   ] Got command RPT from MCS: ref #3867
2018-08-17 06:27:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:27:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3867  77 58347 23257401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:27:37 [DEBUG   ] Got command RPT from MCS: ref #3868
2018-08-17 06:27:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:27:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3868  12 58347 23257605 A  ERRORB“™š'
2018-08-17 06:27:52 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-17 06:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:27:59 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-08-17 06:28:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 06:28:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 06:28:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 06:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:28:59 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-08-17 06:29:12 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 06:29:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 06:29:52 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 06:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:29:59 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-08-17 06:30:03 [DEBUG   ] Got command RPT from MCS: ref #3873
2018-08-17 06:30:03 [DEBUG   ] summary = ERROR
2018-08-17 06:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3873  13 58347 23403614 A  ERRORERROR'
2018-08-17 06:30:03 [DEBUG   ] Got command RPT from MCS: ref #3874
2018-08-17 06:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3874  77 58347 23403614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:30:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 06:30:32 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-17 06:30:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 06:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:30:59 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-17 06:31:12 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-17 06:31:33 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 06:31:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 06:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:31:59 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-08-17 06:32:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 06:32:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 06:32:36 [DEBUG   ] Got command RPT from MCS: ref #3895
2018-08-17 06:32:36 [DEBUG   ] summary = ERROR
2018-08-17 06:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3895  13 58347 23556889 A  ERRORERROR'
2018-08-17 06:32:37 [DEBUG   ] Got command RPT from MCS: ref #3897
2018-08-17 06:32:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3897  77 58347 23557094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:32:37 [DEBUG   ] Got command RPT from MCS: ref #3898
2018-08-17 06:32:37 [DEBUG   ] summary = ERROR
2018-08-17 06:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3898  13 58347 23557285 A  ERRORERROR'
2018-08-17 06:32:37 [DEBUG   ] Got command RPT from MCS: ref #3899
2018-08-17 06:32:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3899  77 58347 23557489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:32:37 [DEBUG   ] Got command RPT from MCS: ref #3900
2018-08-17 06:32:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3900  12 58347 23557693 A  ERRORB“™š'
2018-08-17 06:32:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 06:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:32:59 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-08-17 06:33:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 06:33:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 06:33:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 06:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:33:59 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-08-17 06:34:13 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 06:34:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 06:34:54 [DEBUG   ] Finished updating ant stats in 1.405 seconds
2018-08-17 06:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:34:59 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-08-17 06:35:03 [DEBUG   ] Got command RPT from MCS: ref #3906
2018-08-17 06:35:03 [DEBUG   ] summary = ERROR
2018-08-17 06:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3906  13 58347 23703613 A  ERRORERROR'
2018-08-17 06:35:03 [DEBUG   ] Got command RPT from MCS: ref #3907
2018-08-17 06:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3907  77 58347 23703614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:35:14 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 06:35:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 06:35:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 06:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:35:59 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-08-17 06:36:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 06:36:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 06:36:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 06:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:36:59 [DEBUG   ] Finished updating board flags in 1.518 seconds
2018-08-17 06:37:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 06:37:34 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 06:37:36 [DEBUG   ] Got command RPT from MCS: ref #3927
2018-08-17 06:37:36 [DEBUG   ] summary = ERROR
2018-08-17 06:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3927  13 58347 23856977 A  ERRORERROR'
2018-08-17 06:37:37 [DEBUG   ] Got command RPT from MCS: ref #3928
2018-08-17 06:37:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3928  77 58347 23857181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:37:37 [DEBUG   ] Got command RPT from MCS: ref #3929
2018-08-17 06:37:37 [DEBUG   ] summary = ERROR
2018-08-17 06:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3929  13 58347 23857373 A  ERRORERROR'
2018-08-17 06:37:37 [DEBUG   ] Got command RPT from MCS: ref #3930
2018-08-17 06:37:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3930  77 58347 23857577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:37:37 [DEBUG   ] Got command RPT from MCS: ref #3931
2018-08-17 06:37:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3931  12 58347 23857781 A  ERRORB“™š'
2018-08-17 06:37:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 06:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:38:00 [DEBUG   ] Finished updating board flags in 2.258 seconds
2018-08-17 06:38:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 06:38:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 06:38:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 06:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:39:00 [DEBUG   ] Finished updating board flags in 2.116 seconds
2018-08-17 06:39:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 06:39:34 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-17 06:39:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 06:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:40:00 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-08-17 06:40:03 [DEBUG   ] Got command RPT from MCS: ref #3936
2018-08-17 06:40:03 [DEBUG   ] summary = ERROR
2018-08-17 06:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3936  13 58347 24003621 A  ERRORERROR'
2018-08-17 06:40:03 [DEBUG   ] Got command RPT from MCS: ref #3937
2018-08-17 06:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3937  77 58347 24003622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:40:15 [DEBUG   ] Finished updating ant stats in 1.491 seconds
2018-08-17 06:40:35 [DEBUG   ] Finished updating ant stats in 1.111 seconds
2018-08-17 06:40:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 06:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:41:00 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-08-17 06:41:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 06:41:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 06:41:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 06:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:42:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 06:42:00 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-08-17 06:42:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 06:42:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 06:42:37 [DEBUG   ] Got command RPT from MCS: ref #3959
2018-08-17 06:42:37 [DEBUG   ] summary = ERROR
2018-08-17 06:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3959  13 58347 24157057 A  ERRORERROR'
2018-08-17 06:42:37 [DEBUG   ] Got command RPT from MCS: ref #3960
2018-08-17 06:42:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3960  77 58347 24157261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:42:37 [DEBUG   ] Got command RPT from MCS: ref #3961
2018-08-17 06:42:37 [DEBUG   ] summary = ERROR
2018-08-17 06:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3961  13 58347 24157465 A  ERRORERROR'
2018-08-17 06:42:37 [DEBUG   ] Got command RPT from MCS: ref #3962
2018-08-17 06:42:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3962  77 58347 24157657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:42:37 [DEBUG   ] Got command RPT from MCS: ref #3963
2018-08-17 06:42:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3963  12 58347 24157861 A  ERRORB“™š'
2018-08-17 06:42:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 06:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:43:00 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-08-17 06:43:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 06:43:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 06:43:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 06:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:44:00 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-17 06:44:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 06:44:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 06:44:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 06:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:45:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:45:00 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-17 06:45:03 [DEBUG   ] Got command RPT from MCS: ref #3973
2018-08-17 06:45:03 [DEBUG   ] summary = ERROR
2018-08-17 06:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3973  13 58347 24303617 A  ERRORERROR'
2018-08-17 06:45:03 [DEBUG   ] Got command RPT from MCS: ref #3974
2018-08-17 06:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3974  77 58347 24303618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:45:16 [DEBUG   ] Finished updating ant stats in 1.491 seconds
2018-08-17 06:45:36 [DEBUG   ] Finished updating ant stats in 1.291 seconds
2018-08-17 06:45:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 06:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:46:00 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-08-17 06:46:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 06:46:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 06:46:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 06:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:47:00 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-08-17 06:47:16 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-17 06:47:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 06:47:37 [DEBUG   ] Got command RPT from MCS: ref #3993
2018-08-17 06:47:37 [DEBUG   ] summary = ERROR
2018-08-17 06:47:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3993  13 58347 24457149 A  ERRORERROR'
2018-08-17 06:47:37 [DEBUG   ] Got command RPT from MCS: ref #3995
2018-08-17 06:47:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:47:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3995  77 58347 24457341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:47:37 [DEBUG   ] Got command RPT from MCS: ref #3996
2018-08-17 06:47:37 [DEBUG   ] summary = ERROR
2018-08-17 06:47:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3996  13 58347 24457545 A  ERRORERROR'
2018-08-17 06:47:37 [DEBUG   ] Got command RPT from MCS: ref #3997
2018-08-17 06:47:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:47:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3997  77 58347 24457749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:47:37 [DEBUG   ] Got command RPT from MCS: ref #3998
2018-08-17 06:47:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:47:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3998  12 58347 24457941 A  ERRORB“™š'
2018-08-17 06:47:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 06:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:48:00 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-08-17 06:48:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 06:48:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 06:48:56 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-17 06:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:49:00 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-08-17 06:49:16 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-08-17 06:49:37 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-17 06:49:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 06:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:50:00 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-08-17 06:50:03 [DEBUG   ] Got command RPT from MCS: ref #3999
2018-08-17 06:50:03 [DEBUG   ] summary = ERROR
2018-08-17 06:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     3999  13 58347 24603617 A  ERRORERROR'
2018-08-17 06:50:03 [DEBUG   ] Got command RPT from MCS: ref #4000
2018-08-17 06:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4000  77 58347 24603618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:50:17 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2018-08-17 06:50:37 [DEBUG   ] Finished updating ant stats in 0.831 seconds
2018-08-17 06:50:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 06:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:51:00 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-08-17 06:51:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 06:51:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 06:51:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 06:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:52:00 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-08-17 06:52:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 06:52:37 [DEBUG   ] Got command RPT from MCS: ref #4022
2018-08-17 06:52:37 [DEBUG   ] summary = ERROR
2018-08-17 06:52:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4022  13 58347 24757225 A  ERRORERROR'
2018-08-17 06:52:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 06:52:37 [DEBUG   ] Got command RPT from MCS: ref #4023
2018-08-17 06:52:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:52:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4023  77 58347 24757429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:52:37 [DEBUG   ] Got command RPT from MCS: ref #4024
2018-08-17 06:52:37 [DEBUG   ] summary = ERROR
2018-08-17 06:52:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4024  13 58347 24757633 A  ERRORERROR'
2018-08-17 06:52:37 [DEBUG   ] Got command RPT from MCS: ref #4025
2018-08-17 06:52:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:52:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4025  77 58347 24757825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:52:38 [DEBUG   ] Got command RPT from MCS: ref #4026
2018-08-17 06:52:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4026  12 58347 24758029 A  ERRORB“™š'
2018-08-17 06:52:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 06:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:53:01 [DEBUG   ] Finished updating board flags in 2.219 seconds
2018-08-17 06:53:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 06:53:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 06:53:57 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-17 06:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:54:01 [DEBUG   ] Finished updating board flags in 2.219 seconds
2018-08-17 06:54:18 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 06:54:38 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-17 06:54:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 06:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:55:01 [DEBUG   ] Finished updating board flags in 2.144 seconds
2018-08-17 06:55:03 [DEBUG   ] Got command RPT from MCS: ref #4036
2018-08-17 06:55:03 [DEBUG   ] summary = ERROR
2018-08-17 06:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4036  13 58347 24903625 A  ERRORERROR'
2018-08-17 06:55:03 [DEBUG   ] Got command RPT from MCS: ref #4037
2018-08-17 06:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4037  77 58347 24903626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:55:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 06:55:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 06:55:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 06:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:56:01 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-08-17 06:56:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 06:56:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 06:56:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 06:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:57:01 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-08-17 06:57:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 06:57:37 [DEBUG   ] Got command RPT from MCS: ref #4057
2018-08-17 06:57:37 [DEBUG   ] summary = ERROR
2018-08-17 06:57:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4057  13 58347 25057313 A  ERRORERROR'
2018-08-17 06:57:37 [DEBUG   ] Got command RPT from MCS: ref #4058
2018-08-17 06:57:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:57:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4058  77 58347 25057517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:57:37 [DEBUG   ] Got command RPT from MCS: ref #4059
2018-08-17 06:57:37 [DEBUG   ] summary = ERROR
2018-08-17 06:57:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4059  13 58347 25057723 A  ERRORERROR'
2018-08-17 06:57:37 [DEBUG   ] Got command RPT from MCS: ref #4060
2018-08-17 06:57:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 06:57:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4060  77 58347 25057918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 06:57:38 [DEBUG   ] Got command RPT from MCS: ref #4061
2018-08-17 06:57:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 06:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4061  12 58347 25058121 A  ERRORB“™š'
2018-08-17 06:57:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 06:57:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 06:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:58:01 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-08-17 06:58:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 06:58:39 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 06:58:59 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 06:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 06:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 06:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 06:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 06:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 06:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 06:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 06:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 06:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 06:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 06:59:01 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-08-17 06:59:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 06:59:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 06:59:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 07:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:00:01 [DEBUG   ] Finished updating board flags in 1.649 seconds
2018-08-17 07:00:03 [DEBUG   ] Got command RPT from MCS: ref #4066
2018-08-17 07:00:03 [DEBUG   ] summary = ERROR
2018-08-17 07:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4066  13 58347 25203617 A  ERRORERROR'
2018-08-17 07:00:03 [DEBUG   ] Got command RPT from MCS: ref #4067
2018-08-17 07:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4067  77 58347 25203618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:00:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 07:00:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 07:00:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 07:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:01:01 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-08-17 07:01:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 07:01:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 07:01:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 07:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:02:01 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-08-17 07:02:19 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 07:02:37 [DEBUG   ] Got command RPT from MCS: ref #4088
2018-08-17 07:02:37 [DEBUG   ] summary = ERROR
2018-08-17 07:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4088  13 58347 25357393 A  ERRORERROR'
2018-08-17 07:02:37 [DEBUG   ] Got command RPT from MCS: ref #4090
2018-08-17 07:02:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4090  77 58347 25357597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:02:37 [DEBUG   ] Got command RPT from MCS: ref #4091
2018-08-17 07:02:37 [DEBUG   ] summary = ERROR
2018-08-17 07:02:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4091  13 58347 25357801 A  ERRORERROR'
2018-08-17 07:02:38 [DEBUG   ] Got command RPT from MCS: ref #4092
2018-08-17 07:02:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4092  77 58347 25358005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:02:38 [DEBUG   ] Got command RPT from MCS: ref #4093
2018-08-17 07:02:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4093  12 58347 25358197 A  ERRORB“™š'
2018-08-17 07:02:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 07:02:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 07:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:03:01 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-08-17 07:03:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 07:03:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 07:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:04:00 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 07:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:04:01 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-08-17 07:04:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 07:04:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 07:05:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 07:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:05:01 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-08-17 07:05:03 [DEBUG   ] Got command RPT from MCS: ref #4099
2018-08-17 07:05:03 [DEBUG   ] summary = ERROR
2018-08-17 07:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4099  13 58347 25503621 A  ERRORERROR'
2018-08-17 07:05:03 [DEBUG   ] Got command RPT from MCS: ref #4100
2018-08-17 07:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4100  77 58347 25503622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:05:20 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2018-08-17 07:05:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 07:06:00 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-08-17 07:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:06:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:06:02 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-08-17 07:06:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 07:06:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 07:07:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 07:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:07:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:07:02 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-08-17 07:07:20 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 07:07:37 [DEBUG   ] Got command RPT from MCS: ref #4120
2018-08-17 07:07:37 [DEBUG   ] summary = ERROR
2018-08-17 07:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4120  13 58347 25657477 A  ERRORERROR'
2018-08-17 07:07:37 [DEBUG   ] Got command RPT from MCS: ref #4121
2018-08-17 07:07:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4121  77 58347 25657681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:07:37 [DEBUG   ] Got command RPT from MCS: ref #4122
2018-08-17 07:07:37 [DEBUG   ] summary = ERROR
2018-08-17 07:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4122  13 58347 25657885 A  ERRORERROR'
2018-08-17 07:07:38 [DEBUG   ] Got command RPT from MCS: ref #4123
2018-08-17 07:07:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4123  77 58347 25658089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:07:38 [DEBUG   ] Got command RPT from MCS: ref #4124
2018-08-17 07:07:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4124  12 58347 25658281 A  ERRORB“™š'
2018-08-17 07:07:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 07:08:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 07:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:08:02 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-08-17 07:08:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 07:08:40 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 07:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:09:01 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 07:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:09:02 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-08-17 07:09:21 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-17 07:09:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 07:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:10:01 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2018-08-17 07:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:10:02 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-08-17 07:10:03 [DEBUG   ] Got command RPT from MCS: ref #4129
2018-08-17 07:10:03 [DEBUG   ] summary = ERROR
2018-08-17 07:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4129  13 58347 25803625 A  ERRORERROR'
2018-08-17 07:10:03 [DEBUG   ] Got command RPT from MCS: ref #4130
2018-08-17 07:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4130  77 58347 25803626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:10:21 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-08-17 07:10:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 07:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:11:01 [DEBUG   ] Finished updating ant stats in 1.052 seconds
2018-08-17 07:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:11:02 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-08-17 07:11:21 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2018-08-17 07:11:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 07:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:12:01 [DEBUG   ] Finished updating ant stats in 0.852 seconds
2018-08-17 07:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:12:02 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-08-17 07:12:21 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-08-17 07:12:37 [DEBUG   ] Got command RPT from MCS: ref #4152
2018-08-17 07:12:37 [DEBUG   ] summary = ERROR
2018-08-17 07:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4152  13 58347 25957573 A  ERRORERROR'
2018-08-17 07:12:37 [DEBUG   ] Got command RPT from MCS: ref #4153
2018-08-17 07:12:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4153  77 58347 25957765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:12:37 [DEBUG   ] Got command RPT from MCS: ref #4154
2018-08-17 07:12:37 [DEBUG   ] summary = ERROR
2018-08-17 07:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4154  13 58347 25957969 A  ERRORERROR'
2018-08-17 07:12:38 [DEBUG   ] Got command RPT from MCS: ref #4155
2018-08-17 07:12:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4155  77 58347 25958173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:12:38 [DEBUG   ] Got command RPT from MCS: ref #4157
2018-08-17 07:12:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4157  12 58347 25958377 A  ERRORB“™š'
2018-08-17 07:12:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 07:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:13:02 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 07:13:02 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-08-17 07:13:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 07:13:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 07:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:14:02 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-08-17 07:14:02 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-08-17 07:14:22 [DEBUG   ] Finished updating ant stats in 0.961 seconds
2018-08-17 07:14:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 07:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:15:02 [DEBUG   ] Finished updating ant stats in 1.295 seconds
2018-08-17 07:15:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:15:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:15:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:15:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:15:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:15:03 [DEBUG   ] Got command RPT from MCS: ref #4166
2018-08-17 07:15:03 [DEBUG   ] summary = ERROR
2018-08-17 07:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4166  13 58347 26103622 A  ERRORERROR'
2018-08-17 07:15:03 [DEBUG   ] Got command RPT from MCS: ref #4167
2018-08-17 07:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4167  77 58347 26103622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:15:03 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-08-17 07:15:22 [DEBUG   ] Finished updating ant stats in 0.707 seconds
2018-08-17 07:15:42 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-17 07:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:16:02 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-08-17 07:16:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:16:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:16:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:16:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:16:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:16:03 [DEBUG   ] Finished updating board flags in 2.181 seconds
2018-08-17 07:16:22 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-08-17 07:16:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 07:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:17:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:17:03 [DEBUG   ] Finished updating ant stats in 1.441 seconds
2018-08-17 07:17:03 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-08-17 07:17:23 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2018-08-17 07:17:37 [DEBUG   ] Got command RPT from MCS: ref #4186
2018-08-17 07:17:37 [DEBUG   ] summary = ERROR
2018-08-17 07:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4186  13 58347 26257649 A  ERRORERROR'
2018-08-17 07:17:37 [DEBUG   ] Got command RPT from MCS: ref #4188
2018-08-17 07:17:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4188  77 58347 26257853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:17:38 [DEBUG   ] Got command RPT from MCS: ref #4189
2018-08-17 07:17:38 [DEBUG   ] summary = ERROR
2018-08-17 07:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4189  13 58347 26258057 A  ERRORERROR'
2018-08-17 07:17:38 [DEBUG   ] Got command RPT from MCS: ref #4190
2018-08-17 07:17:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4190  77 58347 26258261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:17:38 [DEBUG   ] Got command RPT from MCS: ref #4191
2018-08-17 07:17:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4191  12 58347 26258453 A  ERRORB“™š'
2018-08-17 07:17:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 07:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:18:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:18:03 [DEBUG   ] Finished updating ant stats in 1.241 seconds
2018-08-17 07:18:03 [DEBUG   ] Finished updating board flags in 2.045 seconds
2018-08-17 07:18:23 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-08-17 07:18:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 07:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:19:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:19:03 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2018-08-17 07:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 07:19:03 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-08-17 07:19:23 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-08-17 07:19:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 07:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:20:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:20:03 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-08-17 07:20:03 [DEBUG   ] Got command RPT from MCS: ref #4192
2018-08-17 07:20:03 [DEBUG   ] summary = ERROR
2018-08-17 07:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4192  13 58347 26403630 A  ERRORERROR'
2018-08-17 07:20:03 [DEBUG   ] Got command RPT from MCS: ref #4193
2018-08-17 07:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4193  77 58347 26403630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:20:03 [DEBUG   ] Finished updating board flags in 2.254 seconds
2018-08-17 07:20:23 [DEBUG   ] Finished updating ant stats in 0.439 seconds
2018-08-17 07:20:44 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-08-17 07:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:21:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:21:03 [DEBUG   ] Finished updating board flags in 1.904 seconds
2018-08-17 07:21:04 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-08-17 07:21:24 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-08-17 07:21:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 07:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:22:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:22:03 [DEBUG   ] Finished updating ant stats in 0.453 seconds
2018-08-17 07:22:03 [DEBUG   ] Finished updating board flags in 1.944 seconds
2018-08-17 07:22:24 [DEBUG   ] Finished updating ant stats in 1.351 seconds
2018-08-17 07:22:37 [DEBUG   ] Got command RPT from MCS: ref #4215
2018-08-17 07:22:37 [DEBUG   ] summary = ERROR
2018-08-17 07:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4215  13 58347 26557741 A  ERRORERROR'
2018-08-17 07:22:37 [DEBUG   ] Got command RPT from MCS: ref #4216
2018-08-17 07:22:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:22:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4216  77 58347 26557946 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:22:38 [DEBUG   ] Got command RPT from MCS: ref #4217
2018-08-17 07:22:38 [DEBUG   ] summary = ERROR
2018-08-17 07:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4217  13 58347 26558138 A  ERRORERROR'
2018-08-17 07:22:38 [DEBUG   ] Got command RPT from MCS: ref #4218
2018-08-17 07:22:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4218  77 58347 26558341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:22:38 [DEBUG   ] Got command RPT from MCS: ref #4220
2018-08-17 07:22:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4220  12 58347 26558545 A  ERRORB“™š'
2018-08-17 07:22:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 07:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:23:03 [DEBUG   ] Finished updating board flags in 1.678 seconds
2018-08-17 07:23:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 07:23:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 07:23:44 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 07:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:24:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:24:03 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-08-17 07:24:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 07:24:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 07:24:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 07:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:25:03 [DEBUG   ] Got command RPT from MCS: ref #4229
2018-08-17 07:25:03 [DEBUG   ] summary = ERROR
2018-08-17 07:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4229  13 58347 26703630 A  ERRORERROR'
2018-08-17 07:25:03 [DEBUG   ] Got command RPT from MCS: ref #4230
2018-08-17 07:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4230  77 58347 26703630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:25:03 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-17 07:25:04 [DEBUG   ] Finished updating ant stats in 0.410 seconds
2018-08-17 07:25:25 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-17 07:25:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 07:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:26:03 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-08-17 07:26:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 07:26:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 07:26:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 07:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:27:03 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-08-17 07:27:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 07:27:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 07:27:37 [DEBUG   ] Got command RPT from MCS: ref #4250
2018-08-17 07:27:37 [DEBUG   ] summary = ERROR
2018-08-17 07:27:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4250  13 58347 26857817 A  ERRORERROR'
2018-08-17 07:27:38 [DEBUG   ] Got command RPT from MCS: ref #4251
2018-08-17 07:27:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4251  77 58347 26858021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:27:38 [DEBUG   ] Got command RPT from MCS: ref #4252
2018-08-17 07:27:38 [DEBUG   ] summary = ERROR
2018-08-17 07:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4252  13 58347 26858225 A  ERRORERROR'
2018-08-17 07:27:38 [DEBUG   ] Got command RPT from MCS: ref #4253
2018-08-17 07:27:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4253  77 58347 26858429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:27:38 [DEBUG   ] Got command RPT from MCS: ref #4254
2018-08-17 07:27:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4254  12 58347 26858621 A  ERRORB“™š'
2018-08-17 07:27:45 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 07:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:28:03 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-08-17 07:28:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 07:28:25 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-08-17 07:28:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 07:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:29:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:29:04 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-08-17 07:29:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 07:29:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 07:29:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 07:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:30:03 [DEBUG   ] Got command RPT from MCS: ref #4259
2018-08-17 07:30:03 [DEBUG   ] summary = ERROR
2018-08-17 07:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4259  13 58347 27003626 A  ERRORERROR'
2018-08-17 07:30:03 [DEBUG   ] Got command RPT from MCS: ref #4260
2018-08-17 07:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4260  77 58347 27003626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:30:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:30:04 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-08-17 07:30:05 [DEBUG   ] Finished updating ant stats in 0.410 seconds
2018-08-17 07:30:26 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2018-08-17 07:30:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 07:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:31:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:31:04 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-08-17 07:31:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 07:31:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 07:31:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 07:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:32:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:32:04 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-08-17 07:32:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 07:32:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 07:32:37 [DEBUG   ] Got command RPT from MCS: ref #4281
2018-08-17 07:32:37 [DEBUG   ] summary = ERROR
2018-08-17 07:32:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4281  13 58347 27157913 A  ERRORERROR'
2018-08-17 07:32:38 [DEBUG   ] Got command RPT from MCS: ref #4283
2018-08-17 07:32:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4283  77 58347 27158106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:32:38 [DEBUG   ] Got command RPT from MCS: ref #4284
2018-08-17 07:32:38 [DEBUG   ] summary = ERROR
2018-08-17 07:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4284  13 58347 27158309 A  ERRORERROR'
2018-08-17 07:32:38 [DEBUG   ] Got command RPT from MCS: ref #4285
2018-08-17 07:32:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4285  77 58347 27158513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:32:38 [DEBUG   ] Got command RPT from MCS: ref #4287
2018-08-17 07:32:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4287  12 58347 27158717 A  ERRORB“™š'
2018-08-17 07:32:46 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 07:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:33:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:33:04 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-17 07:33:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 07:33:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 07:33:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 07:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:34:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:34:04 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-17 07:34:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 07:34:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 07:34:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 07:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:35:03 [DEBUG   ] Got command RPT from MCS: ref #4292
2018-08-17 07:35:03 [DEBUG   ] summary = ERROR
2018-08-17 07:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4292  13 58347 27303630 A  ERRORERROR'
2018-08-17 07:35:03 [DEBUG   ] Got command RPT from MCS: ref #4293
2018-08-17 07:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4293  77 58347 27303630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:35:04 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-08-17 07:35:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-17 07:35:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 07:35:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 07:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:36:04 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-08-17 07:36:06 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-17 07:36:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 07:36:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 07:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:37:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:37:05 [DEBUG   ] Finished updating board flags in 2.178 seconds
2018-08-17 07:37:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 07:37:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 07:37:37 [DEBUG   ] Got command RPT from MCS: ref #4313
2018-08-17 07:37:37 [DEBUG   ] summary = ERROR
2018-08-17 07:37:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4313  13 58347 27457993 A  ERRORERROR'
2018-08-17 07:37:38 [DEBUG   ] Got command RPT from MCS: ref #4314
2018-08-17 07:37:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4314  77 58347 27458197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:37:38 [DEBUG   ] Got command RPT from MCS: ref #4315
2018-08-17 07:37:38 [DEBUG   ] summary = ERROR
2018-08-17 07:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4315  13 58347 27458389 A  ERRORERROR'
2018-08-17 07:37:38 [DEBUG   ] Got command RPT from MCS: ref #4316
2018-08-17 07:37:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4316  77 58347 27458593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:37:38 [DEBUG   ] Got command RPT from MCS: ref #4317
2018-08-17 07:37:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:37:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4317  12 58347 27458797 A  ERRORB“™š'
2018-08-17 07:37:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 07:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:38:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:38:05 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-08-17 07:38:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 07:38:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 07:38:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 07:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:39:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:39:05 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-08-17 07:39:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 07:39:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 07:39:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 07:40:03 [DEBUG   ] Got command RPT from MCS: ref #4322
2018-08-17 07:40:03 [DEBUG   ] summary = ERROR
2018-08-17 07:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4322  13 58347 27603637 A  ERRORERROR'
2018-08-17 07:40:03 [DEBUG   ] Got command RPT from MCS: ref #4323
2018-08-17 07:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4323  77 58347 27603638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:40:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:40:05 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-08-17 07:40:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 07:40:28 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-17 07:40:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 07:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:41:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 07:41:05 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-08-17 07:41:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 07:41:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 07:41:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 07:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:42:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:42:05 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-17 07:42:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 07:42:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 07:42:38 [DEBUG   ] Got command RPT from MCS: ref #4345
2018-08-17 07:42:38 [DEBUG   ] summary = ERROR
2018-08-17 07:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4345  13 58347 27758073 A  ERRORERROR'
2018-08-17 07:42:38 [DEBUG   ] Got command RPT from MCS: ref #4346
2018-08-17 07:42:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4346  77 58347 27758277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:42:38 [DEBUG   ] Got command RPT from MCS: ref #4347
2018-08-17 07:42:38 [DEBUG   ] summary = ERROR
2018-08-17 07:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4347  13 58347 27758481 A  ERRORERROR'
2018-08-17 07:42:38 [DEBUG   ] Got command RPT from MCS: ref #4348
2018-08-17 07:42:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4348  77 58347 27758685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:42:38 [DEBUG   ] Got command RPT from MCS: ref #4350
2018-08-17 07:42:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:42:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4350  12 58347 27758877 A  ERRORB“™š'
2018-08-17 07:42:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 07:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:43:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:43:05 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-08-17 07:43:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 07:43:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 07:43:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 07:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:44:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:44:05 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-17 07:44:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 07:44:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 07:44:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 07:45:03 [DEBUG   ] Got command RPT from MCS: ref #4359
2018-08-17 07:45:03 [DEBUG   ] summary = ERROR
2018-08-17 07:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4359  13 58347 27903637 A  ERRORERROR'
2018-08-17 07:45:03 [DEBUG   ] Got command RPT from MCS: ref #4360
2018-08-17 07:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4360  77 58347 27903638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:45:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:45:05 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-08-17 07:45:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 07:45:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-17 07:45:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 07:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:46:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:46:05 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-08-17 07:46:09 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2018-08-17 07:46:29 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-08-17 07:46:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 07:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:47:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:47:05 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-08-17 07:47:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 07:47:29 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 07:47:38 [DEBUG   ] Got command RPT from MCS: ref #4379
2018-08-17 07:47:38 [DEBUG   ] summary = ERROR
2018-08-17 07:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4379  13 58347 28058161 A  ERRORERROR'
2018-08-17 07:47:38 [DEBUG   ] Got command RPT from MCS: ref #4381
2018-08-17 07:47:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4381  77 58347 28058365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:47:38 [DEBUG   ] Got command RPT from MCS: ref #4382
2018-08-17 07:47:38 [DEBUG   ] summary = ERROR
2018-08-17 07:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4382  13 58347 28058569 A  ERRORERROR'
2018-08-17 07:47:38 [DEBUG   ] Got command RPT from MCS: ref #4383
2018-08-17 07:47:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4383  77 58347 28058761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:47:38 [DEBUG   ] Got command RPT from MCS: ref #4384
2018-08-17 07:47:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:47:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4384  12 58347 28058965 A  ERRORB“™š'
2018-08-17 07:47:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 07:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:48:05 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-08-17 07:48:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 07:48:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 07:48:49 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 07:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:49:05 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-17 07:49:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 07:49:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 07:49:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 07:50:03 [DEBUG   ] Got command RPT from MCS: ref #4385
2018-08-17 07:50:03 [DEBUG   ] summary = ERROR
2018-08-17 07:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4385  13 58347 28203641 A  ERRORERROR'
2018-08-17 07:50:03 [DEBUG   ] Got command RPT from MCS: ref #4386
2018-08-17 07:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4386  77 58347 28203642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:50:05 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-08-17 07:50:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 07:50:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 07:50:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 07:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:51:05 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-08-17 07:51:09 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-17 07:51:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 07:51:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 07:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:52:05 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-08-17 07:52:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 07:52:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 07:52:38 [DEBUG   ] Got command RPT from MCS: ref #4408
2018-08-17 07:52:38 [DEBUG   ] summary = ERROR
2018-08-17 07:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4408  13 58347 28358245 A  ERRORERROR'
2018-08-17 07:52:38 [DEBUG   ] Got command RPT from MCS: ref #4409
2018-08-17 07:52:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4409  77 58347 28358449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:52:38 [DEBUG   ] Got command RPT from MCS: ref #4410
2018-08-17 07:52:38 [DEBUG   ] summary = ERROR
2018-08-17 07:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4410  13 58347 28358653 A  ERRORERROR'
2018-08-17 07:52:38 [DEBUG   ] Got command RPT from MCS: ref #4411
2018-08-17 07:52:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:52:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4411  77 58347 28358845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:52:39 [DEBUG   ] Got command RPT from MCS: ref #4413
2018-08-17 07:52:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4413  12 58347 28359049 A  ERRORB”™š'
2018-08-17 07:52:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 07:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:53:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:53:06 [DEBUG   ] Finished updating board flags in 2.238 seconds
2018-08-17 07:53:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 07:53:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 07:53:50 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 07:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:54:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:54:06 [DEBUG   ] Finished updating board flags in 2.142 seconds
2018-08-17 07:54:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 07:54:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 07:54:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 07:55:03 [DEBUG   ] Got command RPT from MCS: ref #4422
2018-08-17 07:55:03 [DEBUG   ] summary = ERROR
2018-08-17 07:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4422  13 58347 28503637 A  ERRORERROR'
2018-08-17 07:55:03 [DEBUG   ] Got command RPT from MCS: ref #4423
2018-08-17 07:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4423  77 58347 28503638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:55:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:55:06 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-08-17 07:55:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 07:55:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 07:55:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 07:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:56:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:56:06 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-08-17 07:56:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 07:56:31 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 07:56:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 07:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:57:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:57:06 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-08-17 07:57:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 07:57:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 07:57:38 [DEBUG   ] Got command RPT from MCS: ref #4443
2018-08-17 07:57:38 [DEBUG   ] summary = ERROR
2018-08-17 07:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4443  13 58347 28658333 A  ERRORERROR'
2018-08-17 07:57:38 [DEBUG   ] Got command RPT from MCS: ref #4444
2018-08-17 07:57:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4444  77 58347 28658537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:57:38 [DEBUG   ] Got command RPT from MCS: ref #4445
2018-08-17 07:57:38 [DEBUG   ] summary = ERROR
2018-08-17 07:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4445  13 58347 28658729 A  ERRORERROR'
2018-08-17 07:57:38 [DEBUG   ] Got command RPT from MCS: ref #4446
2018-08-17 07:57:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 07:57:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4446  77 58347 28658933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 07:57:39 [DEBUG   ] Got command RPT from MCS: ref #4447
2018-08-17 07:57:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 07:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4447  12 58347 28659137 A  ERRORB“™š'
2018-08-17 07:57:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 07:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:58:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:58:06 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-08-17 07:58:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 07:58:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 07:58:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 07:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 07:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 07:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 07:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 07:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 07:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 07:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 07:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 07:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 07:59:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 07:59:06 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-08-17 07:59:11 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-08-17 07:59:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 07:59:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 08:00:03 [DEBUG   ] Got command RPT from MCS: ref #4452
2018-08-17 08:00:03 [DEBUG   ] summary = ERROR
2018-08-17 08:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4452  13 58347 28803641 A  ERRORERROR'
2018-08-17 08:00:03 [DEBUG   ] Got command RPT from MCS: ref #4453
2018-08-17 08:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4453  77 58347 28803642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:00:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:00:06 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-08-17 08:00:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 08:00:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 08:00:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 08:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:01:06 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-08-17 08:01:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 08:01:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 08:01:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 08:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:02:06 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-08-17 08:02:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 08:02:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 08:02:38 [DEBUG   ] Got command RPT from MCS: ref #4474
2018-08-17 08:02:38 [DEBUG   ] summary = ERROR
2018-08-17 08:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4474  13 58347 28958413 A  ERRORERROR'
2018-08-17 08:02:38 [DEBUG   ] Got command RPT from MCS: ref #4476
2018-08-17 08:02:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4476  77 58347 28958617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:02:38 [DEBUG   ] Got command RPT from MCS: ref #4477
2018-08-17 08:02:38 [DEBUG   ] summary = ERROR
2018-08-17 08:02:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4477  13 58347 28958821 A  ERRORERROR'
2018-08-17 08:02:39 [DEBUG   ] Got command RPT from MCS: ref #4478
2018-08-17 08:02:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4478  77 58347 28959025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:02:39 [DEBUG   ] Got command RPT from MCS: ref #4480
2018-08-17 08:02:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4480  12 58347 28959217 A  ERRORB“™š'
2018-08-17 08:02:51 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-08-17 08:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:03:06 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-08-17 08:03:12 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-17 08:03:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-17 08:03:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 08:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:04:06 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-08-17 08:04:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 08:04:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 08:04:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 08:05:03 [DEBUG   ] Got command RPT from MCS: ref #4485
2018-08-17 08:05:03 [DEBUG   ] summary = ERROR
2018-08-17 08:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4485  13 58347 29103634 A  ERRORERROR'
2018-08-17 08:05:03 [DEBUG   ] Got command RPT from MCS: ref #4486
2018-08-17 08:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4486  77 58347 29103634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:05:06 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-08-17 08:05:12 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 08:05:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 08:05:52 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 08:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:06:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:06:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 08:06:07 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-08-17 08:06:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 08:06:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 08:06:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 08:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:07:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:07:07 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-08-17 08:07:13 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 08:07:33 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 08:07:38 [DEBUG   ] Got command RPT from MCS: ref #4506
2018-08-17 08:07:38 [DEBUG   ] summary = ERROR
2018-08-17 08:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4506  13 58347 29258505 A  ERRORERROR'
2018-08-17 08:07:38 [DEBUG   ] Got command RPT from MCS: ref #4507
2018-08-17 08:07:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4507  77 58347 29258698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:07:38 [DEBUG   ] Got command RPT from MCS: ref #4508
2018-08-17 08:07:38 [DEBUG   ] summary = ERROR
2018-08-17 08:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4508  13 58347 29258901 A  ERRORERROR'
2018-08-17 08:07:39 [DEBUG   ] Got command RPT from MCS: ref #4509
2018-08-17 08:07:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4509  77 58347 29259105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:07:39 [DEBUG   ] Got command RPT from MCS: ref #4510
2018-08-17 08:07:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4510  12 58347 29259309 A  ERRORB“™š'
2018-08-17 08:07:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 08:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:08:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:08:07 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-17 08:08:13 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 08:08:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 08:08:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 08:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:09:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:09:07 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-08-17 08:09:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 08:09:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 08:09:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 08:10:03 [DEBUG   ] Got command RPT from MCS: ref #4515
2018-08-17 08:10:03 [DEBUG   ] summary = ERROR
2018-08-17 08:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4515  13 58347 29403637 A  ERRORERROR'
2018-08-17 08:10:03 [DEBUG   ] Got command RPT from MCS: ref #4516
2018-08-17 08:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4516  77 58347 29403638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:10:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:10:07 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-08-17 08:10:13 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-17 08:10:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 08:10:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 08:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:11:07 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-17 08:11:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 08:11:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 08:11:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 08:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:12:07 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-08-17 08:12:14 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 08:12:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 08:12:38 [DEBUG   ] Got command RPT from MCS: ref #4538
2018-08-17 08:12:38 [DEBUG   ] summary = ERROR
2018-08-17 08:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4538  13 58347 29558581 A  ERRORERROR'
2018-08-17 08:12:38 [DEBUG   ] Got command RPT from MCS: ref #4539
2018-08-17 08:12:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4539  77 58347 29558785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:12:38 [DEBUG   ] Got command RPT from MCS: ref #4540
2018-08-17 08:12:38 [DEBUG   ] summary = ERROR
2018-08-17 08:12:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4540  13 58347 29558989 A  ERRORERROR'
2018-08-17 08:12:39 [DEBUG   ] Got command RPT from MCS: ref #4541
2018-08-17 08:12:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:12:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4541  77 58347 29559193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:12:39 [DEBUG   ] Got command RPT from MCS: ref #4543
2018-08-17 08:12:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:12:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4543  12 58347 29559385 A  ERRORB“™š'
2018-08-17 08:12:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 08:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:13:07 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-17 08:13:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 08:13:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 08:13:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 08:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:14:07 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-08-17 08:14:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 08:14:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 08:14:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 08:15:03 [DEBUG   ] Got command RPT from MCS: ref #4552
2018-08-17 08:15:03 [DEBUG   ] summary = ERROR
2018-08-17 08:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4552  13 58347 29703637 A  ERRORERROR'
2018-08-17 08:15:03 [DEBUG   ] Got command RPT from MCS: ref #4553
2018-08-17 08:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4553  77 58347 29703638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:15:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:15:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 08:15:08 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-08-17 08:15:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 08:15:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 08:15:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 08:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:16:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:16:08 [DEBUG   ] Finished updating board flags in 2.175 seconds
2018-08-17 08:16:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 08:16:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 08:16:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 08:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:17:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:17:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 08:17:08 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-08-17 08:17:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 08:17:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 08:17:38 [DEBUG   ] Got command RPT from MCS: ref #4572
2018-08-17 08:17:38 [DEBUG   ] summary = ERROR
2018-08-17 08:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4572  13 58347 29858669 A  ERRORERROR'
2018-08-17 08:17:38 [DEBUG   ] Got command RPT from MCS: ref #4574
2018-08-17 08:17:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:17:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4574  77 58347 29858873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:17:39 [DEBUG   ] Got command RPT from MCS: ref #4575
2018-08-17 08:17:39 [DEBUG   ] summary = ERROR
2018-08-17 08:17:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4575  13 58347 29859077 A  ERRORERROR'
2018-08-17 08:17:39 [DEBUG   ] Got command RPT from MCS: ref #4576
2018-08-17 08:17:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:17:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4576  77 58347 29859281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:17:39 [DEBUG   ] Got command RPT from MCS: ref #4577
2018-08-17 08:17:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:17:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4577  12 58347 29859473 A  ERRORB“™š'
2018-08-17 08:17:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 08:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:18:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:18:08 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-08-17 08:18:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 08:18:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 08:18:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 08:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:19:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:19:08 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-08-17 08:19:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 08:19:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 08:19:55 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 08:20:03 [DEBUG   ] Got command RPT from MCS: ref #4578
2018-08-17 08:20:03 [DEBUG   ] summary = ERROR
2018-08-17 08:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4578  13 58347 30003641 A  ERRORERROR'
2018-08-17 08:20:03 [DEBUG   ] Got command RPT from MCS: ref #4579
2018-08-17 08:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4579  77 58347 30003642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:20:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:20:08 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-08-17 08:20:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 08:20:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 08:20:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 08:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:21:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:21:08 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-08-17 08:21:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 08:21:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 08:21:56 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 08:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:22:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:22:08 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-08-17 08:22:16 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-17 08:22:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 08:22:38 [DEBUG   ] Got command RPT from MCS: ref #4601
2018-08-17 08:22:38 [DEBUG   ] summary = ERROR
2018-08-17 08:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4601  13 58347 30158761 A  ERRORERROR'
2018-08-17 08:22:38 [DEBUG   ] Got command RPT from MCS: ref #4602
2018-08-17 08:22:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4602  77 58347 30158953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:22:39 [DEBUG   ] Got command RPT from MCS: ref #4603
2018-08-17 08:22:39 [DEBUG   ] summary = ERROR
2018-08-17 08:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4603  13 58347 30159157 A  ERRORERROR'
2018-08-17 08:22:39 [DEBUG   ] Got command RPT from MCS: ref #4604
2018-08-17 08:22:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4604  77 58347 30159361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:22:39 [DEBUG   ] Got command RPT from MCS: ref #4606
2018-08-17 08:22:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4606  12 58347 30159565 A  ERRORB“™š'
2018-08-17 08:22:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 08:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:23:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:23:08 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-08-17 08:23:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 08:23:36 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 08:23:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 08:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:24:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:24:08 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-08-17 08:24:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 08:24:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 08:24:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 08:25:03 [DEBUG   ] Got command RPT from MCS: ref #4615
2018-08-17 08:25:03 [DEBUG   ] summary = ERROR
2018-08-17 08:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4615  13 58347 30303649 A  ERRORERROR'
2018-08-17 08:25:03 [DEBUG   ] Got command RPT from MCS: ref #4616
2018-08-17 08:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4616  77 58347 30303650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:25:08 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-08-17 08:25:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 08:25:37 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 08:25:57 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-17 08:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:26:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:26:09 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-08-17 08:26:17 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-08-17 08:26:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 08:26:57 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 08:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:27:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:27:09 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-08-17 08:27:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 08:27:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 08:27:38 [DEBUG   ] Got command RPT from MCS: ref #4636
2018-08-17 08:27:38 [DEBUG   ] summary = ERROR
2018-08-17 08:27:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4636  13 58347 30458837 A  ERRORERROR'
2018-08-17 08:27:39 [DEBUG   ] Got command RPT from MCS: ref #4637
2018-08-17 08:27:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4637  77 58347 30459041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:27:39 [DEBUG   ] Got command RPT from MCS: ref #4638
2018-08-17 08:27:39 [DEBUG   ] summary = ERROR
2018-08-17 08:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4638  13 58347 30459245 A  ERRORERROR'
2018-08-17 08:27:39 [DEBUG   ] Got command RPT from MCS: ref #4639
2018-08-17 08:27:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4639  77 58347 30459449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:27:39 [DEBUG   ] Got command RPT from MCS: ref #4640
2018-08-17 08:27:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4640  12 58347 30459641 A  ERRORB“™š'
2018-08-17 08:27:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 08:28:00 [DEBUG   ] Got command TBN from MCS: ref #4641
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-08-17 08:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     4641   8 58347 30480465 A  ERROR'
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1534494481']
2018-08-17 08:28:00 [DEBUG   ] spawn_process: at 2018-08-17 08:28:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1534494481']
2018-08-17 08:28:00 [INFO    ] Finished spawning TBN in 0.054 s
2018-08-17 08:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:28:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:28:09 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-08-17 08:28:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 08:28:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 08:28:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 08:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:29:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:29:09 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-08-17 08:29:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 08:29:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 08:29:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 08:30:03 [DEBUG   ] Got command RPT from MCS: ref #4646
2018-08-17 08:30:03 [DEBUG   ] summary = ERROR
2018-08-17 08:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4646  13 58347 30603649 A  ERRORERROR'
2018-08-17 08:30:03 [DEBUG   ] Got command RPT from MCS: ref #4647
2018-08-17 08:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4647  77 58347 30603650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:30:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:30:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 08:30:09 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-08-17 08:30:17 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-08-17 08:30:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 08:30:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 08:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:31:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:31:09 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-17 08:31:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 08:31:37 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-08-17 08:31:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 08:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:32:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:32:09 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-08-17 08:32:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 08:32:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 08:32:38 [DEBUG   ] Got command RPT from MCS: ref #4668
2018-08-17 08:32:38 [DEBUG   ] summary = ERROR
2018-08-17 08:32:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4668  13 58347 30758925 A  ERRORERROR'
2018-08-17 08:32:39 [DEBUG   ] Got command RPT from MCS: ref #4670
2018-08-17 08:32:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4670  77 58347 30759129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:32:39 [DEBUG   ] Got command RPT from MCS: ref #4671
2018-08-17 08:32:39 [DEBUG   ] summary = ERROR
2018-08-17 08:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4671  13 58347 30759333 A  ERRORERROR'
2018-08-17 08:32:39 [DEBUG   ] Got command RPT from MCS: ref #4672
2018-08-17 08:32:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4672  77 58347 30759525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:32:39 [DEBUG   ] Got command RPT from MCS: ref #4674
2018-08-17 08:32:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4674  12 58347 30759729 A  ERRORB“™š'
2018-08-17 08:32:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 08:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:33:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:33:09 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-08-17 08:33:18 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 08:33:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 08:33:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 08:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:34:09 [DEBUG   ] Finished updating board flags in 1.347 seconds
2018-08-17 08:34:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 08:34:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 08:34:59 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-17 08:35:03 [DEBUG   ] Got command RPT from MCS: ref #4679
2018-08-17 08:35:03 [DEBUG   ] summary = ERROR
2018-08-17 08:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4679  13 58347 30903645 A  ERRORERROR'
2018-08-17 08:35:03 [DEBUG   ] Got command RPT from MCS: ref #4680
2018-08-17 08:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4680  77 58347 30903646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:35:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:35:10 [DEBUG   ] Finished updating board flags in 2.073 seconds
2018-08-17 08:35:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 08:35:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 08:35:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 08:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:36:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:36:10 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-08-17 08:36:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 08:36:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 08:36:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 08:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:37:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:37:10 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-08-17 08:37:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 08:37:39 [DEBUG   ] Got command RPT from MCS: ref #4700
2018-08-17 08:37:39 [DEBUG   ] summary = ERROR
2018-08-17 08:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4700  13 58347 31059013 A  ERRORERROR'
2018-08-17 08:37:39 [DEBUG   ] Got command RPT from MCS: ref #4701
2018-08-17 08:37:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4701  77 58347 31059217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:37:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 08:37:39 [DEBUG   ] Got command RPT from MCS: ref #4702
2018-08-17 08:37:39 [DEBUG   ] summary = ERROR
2018-08-17 08:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4702  13 58347 31059409 A  ERRORERROR'
2018-08-17 08:37:39 [DEBUG   ] Got command RPT from MCS: ref #4703
2018-08-17 08:37:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4703  77 58347 31059613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:37:39 [DEBUG   ] Got command RPT from MCS: ref #4704
2018-08-17 08:37:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:37:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4704  12 58347 31059817 A  ERRORB“™š'
2018-08-17 08:37:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 08:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:38:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:38:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 08:38:10 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-17 08:38:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 08:38:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 08:39:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 08:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:39:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:39:10 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-08-17 08:39:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-17 08:39:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 08:40:00 [DEBUG   ] Finished updating ant stats in 0.978 seconds
2018-08-17 08:40:03 [DEBUG   ] Got command RPT from MCS: ref #4709
2018-08-17 08:40:03 [DEBUG   ] summary = ERROR
2018-08-17 08:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4709  13 58347 31203653 A  ERRORERROR'
2018-08-17 08:40:03 [DEBUG   ] Got command RPT from MCS: ref #4710
2018-08-17 08:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4710  77 58347 31203654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:40:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:40:10 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-08-17 08:40:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 08:40:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 08:41:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 08:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:41:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:41:10 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-08-17 08:41:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 08:41:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 08:42:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 08:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:42:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:42:10 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-08-17 08:42:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 08:42:39 [DEBUG   ] Got command RPT from MCS: ref #4732
2018-08-17 08:42:39 [DEBUG   ] summary = ERROR
2018-08-17 08:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4732  13 58347 31359089 A  ERRORERROR'
2018-08-17 08:42:39 [DEBUG   ] Got command RPT from MCS: ref #4733
2018-08-17 08:42:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4733  77 58347 31359293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:42:39 [DEBUG   ] Got command RPT from MCS: ref #4734
2018-08-17 08:42:39 [DEBUG   ] summary = ERROR
2018-08-17 08:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4734  13 58347 31359497 A  ERRORERROR'
2018-08-17 08:42:39 [DEBUG   ] Got command RPT from MCS: ref #4735
2018-08-17 08:42:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4735  77 58347 31359701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:42:39 [DEBUG   ] Got command RPT from MCS: ref #4737
2018-08-17 08:42:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:42:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4737  12 58347 31359893 A  ERRORB“™š'
2018-08-17 08:42:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 08:43:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 08:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:43:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:43:10 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-08-17 08:43:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 08:43:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 08:44:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 08:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:44:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:44:10 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-08-17 08:44:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 08:44:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 08:45:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 08:45:03 [DEBUG   ] Got command RPT from MCS: ref #4746
2018-08-17 08:45:03 [DEBUG   ] summary = ERROR
2018-08-17 08:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4746  13 58347 31503645 A  ERRORERROR'
2018-08-17 08:45:03 [DEBUG   ] Got command RPT from MCS: ref #4747
2018-08-17 08:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4747  77 58347 31503646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:45:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:45:11 [DEBUG   ] Finished updating board flags in 2.051 seconds
2018-08-17 08:45:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 08:45:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 08:46:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 08:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 08:46:11 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-08-17 08:46:21 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 08:46:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 08:47:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 08:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:47:11 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-08-17 08:47:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 08:47:39 [DEBUG   ] Got command RPT from MCS: ref #4766
2018-08-17 08:47:39 [DEBUG   ] summary = ERROR
2018-08-17 08:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4766  13 58347 31659177 A  ERRORERROR'
2018-08-17 08:47:39 [DEBUG   ] Got command RPT from MCS: ref #4768
2018-08-17 08:47:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4768  77 58347 31659381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:47:39 [DEBUG   ] Got command RPT from MCS: ref #4769
2018-08-17 08:47:39 [DEBUG   ] summary = ERROR
2018-08-17 08:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4769  13 58347 31659573 A  ERRORERROR'
2018-08-17 08:47:39 [DEBUG   ] Got command RPT from MCS: ref #4770
2018-08-17 08:47:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4770  77 58347 31659777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:47:39 [DEBUG   ] Got command RPT from MCS: ref #4771
2018-08-17 08:47:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:47:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4771  12 58347 31659981 A  ERRORB”™š'
2018-08-17 08:47:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 08:48:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 08:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:48:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 08:48:11 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-08-17 08:48:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 08:48:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 08:49:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 08:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:49:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 08:49:11 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-08-17 08:49:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 08:49:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 08:50:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 08:50:03 [DEBUG   ] Got command RPT from MCS: ref #4772
2018-08-17 08:50:03 [DEBUG   ] summary = ERROR
2018-08-17 08:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4772  13 58347 31803649 A  ERRORERROR'
2018-08-17 08:50:03 [DEBUG   ] Got command RPT from MCS: ref #4773
2018-08-17 08:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4773  77 58347 31803650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:50:11 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-08-17 08:50:22 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 08:50:43 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-17 08:51:03 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 08:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:51:11 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-08-17 08:51:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 08:51:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 08:52:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 08:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:52:11 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-08-17 08:52:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 08:52:39 [DEBUG   ] Got command RPT from MCS: ref #4795
2018-08-17 08:52:39 [DEBUG   ] summary = ERROR
2018-08-17 08:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4795  13 58347 31959257 A  ERRORERROR'
2018-08-17 08:52:39 [DEBUG   ] Got command RPT from MCS: ref #4796
2018-08-17 08:52:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4796  77 58347 31959461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:52:39 [DEBUG   ] Got command RPT from MCS: ref #4797
2018-08-17 08:52:39 [DEBUG   ] summary = ERROR
2018-08-17 08:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4797  13 58347 31959665 A  ERRORERROR'
2018-08-17 08:52:39 [DEBUG   ] Got command RPT from MCS: ref #4798
2018-08-17 08:52:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4798  77 58347 31959857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:52:40 [DEBUG   ] Got command RPT from MCS: ref #4800
2018-08-17 08:52:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4800  12 58347 31960061 A  ERRORB“™š'
2018-08-17 08:52:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 08:53:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 08:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:53:11 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-08-17 08:53:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 08:53:43 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-08-17 08:54:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 08:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:54:11 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-08-17 08:54:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 08:54:43 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-08-17 08:55:03 [DEBUG   ] Got command RPT from MCS: ref #4809
2018-08-17 08:55:03 [DEBUG   ] summary = ERROR
2018-08-17 08:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4809  13 58347 32103658 A  ERRORERROR'
2018-08-17 08:55:03 [DEBUG   ] Got command RPT from MCS: ref #4810
2018-08-17 08:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4810  77 58347 32103658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:55:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 08:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:55:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:55:11 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-08-17 08:55:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 08:55:44 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 08:56:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 08:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:56:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:56:11 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-08-17 08:56:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 08:56:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 08:57:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 08:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:57:12 [DEBUG   ] Finished updating board flags in 2.213 seconds
2018-08-17 08:57:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 08:57:39 [DEBUG   ] Got command RPT from MCS: ref #4830
2018-08-17 08:57:39 [DEBUG   ] summary = ERROR
2018-08-17 08:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4830  13 58347 32259341 A  ERRORERROR'
2018-08-17 08:57:39 [DEBUG   ] Got command RPT from MCS: ref #4831
2018-08-17 08:57:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4831  77 58347 32259545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:57:39 [DEBUG   ] Got command RPT from MCS: ref #4832
2018-08-17 08:57:39 [DEBUG   ] summary = ERROR
2018-08-17 08:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4832  13 58347 32259749 A  ERRORERROR'
2018-08-17 08:57:39 [DEBUG   ] Got command RPT from MCS: ref #4833
2018-08-17 08:57:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 08:57:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4833  77 58347 32259941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 08:57:40 [DEBUG   ] Got command RPT from MCS: ref #4834
2018-08-17 08:57:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 08:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4834  12 58347 32260145 A  ERRORB“™š'
2018-08-17 08:57:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 08:58:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 08:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:58:12 [DEBUG   ] Finished updating board flags in 2.227 seconds
2018-08-17 08:58:24 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-08-17 08:58:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 08:59:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 08:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 08:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 08:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 08:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 08:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 08:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 08:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 08:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 08:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 08:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 08:59:12 [DEBUG   ] Finished updating board flags in 2.112 seconds
2018-08-17 08:59:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 08:59:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 09:00:03 [DEBUG   ] Got command RPT from MCS: ref #4839
2018-08-17 09:00:03 [DEBUG   ] summary = ERROR
2018-08-17 09:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4839  13 58347 32403653 A  ERRORERROR'
2018-08-17 09:00:03 [DEBUG   ] Got command RPT from MCS: ref #4840
2018-08-17 09:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4840  77 58347 32403654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:00:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 09:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:00:12 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-08-17 09:00:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 09:00:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 09:01:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 09:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:01:12 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-08-17 09:01:25 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-08-17 09:01:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 09:02:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 09:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:02:12 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-08-17 09:02:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 09:02:39 [DEBUG   ] Got command RPT from MCS: ref #4860
2018-08-17 09:02:39 [DEBUG   ] summary = ERROR
2018-08-17 09:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4860  13 58347 32559425 A  ERRORERROR'
2018-08-17 09:02:39 [DEBUG   ] Got command RPT from MCS: ref #4862
2018-08-17 09:02:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4862  77 58347 32559629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:02:39 [DEBUG   ] Got command RPT from MCS: ref #4864
2018-08-17 09:02:39 [DEBUG   ] summary = ERROR
2018-08-17 09:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4864  13 58347 32559821 A  ERRORERROR'
2018-08-17 09:02:40 [DEBUG   ] Got command RPT from MCS: ref #4865
2018-08-17 09:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4865  77 58347 32560025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:02:40 [DEBUG   ] Got command RPT from MCS: ref #4867
2018-08-17 09:02:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4867  12 58347 32560229 A  ERRORB“™š'
2018-08-17 09:02:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 09:03:05 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 09:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:03:12 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-08-17 09:03:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 09:03:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 09:04:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 09:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:04:12 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-08-17 09:04:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 09:04:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 09:05:03 [DEBUG   ] Got command RPT from MCS: ref #4872
2018-08-17 09:05:03 [DEBUG   ] summary = ERROR
2018-08-17 09:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4872  13 58347 32703649 A  ERRORERROR'
2018-08-17 09:05:03 [DEBUG   ] Got command RPT from MCS: ref #4873
2018-08-17 09:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4873  77 58347 32703650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:05:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 09:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:05:12 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-08-17 09:05:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 09:05:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 09:06:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 09:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:06:12 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-08-17 09:06:26 [DEBUG   ] Finished updating ant stats in 0.763 seconds
2018-08-17 09:06:46 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 09:07:07 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 09:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:07:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:07:12 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-08-17 09:07:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 09:07:39 [DEBUG   ] Got command RPT from MCS: ref #4893
2018-08-17 09:07:39 [DEBUG   ] summary = ERROR
2018-08-17 09:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4893  13 58347 32859514 A  ERRORERROR'
2018-08-17 09:07:39 [DEBUG   ] Got command RPT from MCS: ref #4894
2018-08-17 09:07:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4894  77 58347 32859717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:07:39 [DEBUG   ] Got command RPT from MCS: ref #4895
2018-08-17 09:07:39 [DEBUG   ] summary = ERROR
2018-08-17 09:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4895  13 58347 32859910 A  ERRORERROR'
2018-08-17 09:07:40 [DEBUG   ] Got command RPT from MCS: ref #4896
2018-08-17 09:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4896  77 58347 32860114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:07:40 [DEBUG   ] Got command RPT from MCS: ref #4897
2018-08-17 09:07:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4897  12 58347 32860317 A  ERRORB“™š'
2018-08-17 09:07:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 09:08:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 09:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:08:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:08:12 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-17 09:08:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 09:08:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 09:09:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 09:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:09:12 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-08-17 09:09:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 09:09:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 09:10:03 [DEBUG   ] Got command RPT from MCS: ref #4902
2018-08-17 09:10:03 [DEBUG   ] summary = ERROR
2018-08-17 09:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4902  13 58347 33003657 A  ERRORERROR'
2018-08-17 09:10:03 [DEBUG   ] Got command RPT from MCS: ref #4903
2018-08-17 09:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4903  77 58347 33003658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:10:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 09:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:10:12 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-08-17 09:10:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 09:10:48 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 09:11:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 09:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:11:12 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-08-17 09:11:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 09:11:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 09:12:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 09:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:12:12 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-08-17 09:12:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 09:12:39 [DEBUG   ] Got command RPT from MCS: ref #4925
2018-08-17 09:12:39 [DEBUG   ] summary = ERROR
2018-08-17 09:12:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4925  13 58347 33159593 A  ERRORERROR'
2018-08-17 09:12:39 [DEBUG   ] Got command RPT from MCS: ref #4926
2018-08-17 09:12:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:12:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4926  77 58347 33159797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:12:40 [DEBUG   ] Got command RPT from MCS: ref #4927
2018-08-17 09:12:40 [DEBUG   ] summary = ERROR
2018-08-17 09:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4927  13 58347 33160001 A  ERRORERROR'
2018-08-17 09:12:40 [DEBUG   ] Got command RPT from MCS: ref #4928
2018-08-17 09:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4928  77 58347 33160193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:12:40 [DEBUG   ] Got command RPT from MCS: ref #4930
2018-08-17 09:12:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4930  12 58347 33160397 A  ERRORB“™š'
2018-08-17 09:12:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 09:13:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 09:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:13:13 [DEBUG   ] Finished updating board flags in 2.231 seconds
2018-08-17 09:13:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 09:13:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 09:14:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 09:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:14:13 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-08-17 09:14:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 09:14:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 09:15:03 [DEBUG   ] Got command RPT from MCS: ref #4939
2018-08-17 09:15:03 [DEBUG   ] summary = ERROR
2018-08-17 09:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4939  13 58347 33303657 A  ERRORERROR'
2018-08-17 09:15:03 [DEBUG   ] Got command RPT from MCS: ref #4940
2018-08-17 09:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4940  77 58347 33303658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:15:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 09:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:15:13 [DEBUG   ] Finished updating board flags in 2.157 seconds
2018-08-17 09:15:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 09:15:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 09:16:08 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-17 09:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:16:13 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-08-17 09:16:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 09:16:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 09:17:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 09:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:17:13 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-08-17 09:17:28 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 09:17:39 [DEBUG   ] Got command RPT from MCS: ref #4958
2018-08-17 09:17:39 [DEBUG   ] summary = ERROR
2018-08-17 09:17:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4958  13 58347 33459681 A  ERRORERROR'
2018-08-17 09:17:39 [DEBUG   ] Got command RPT from MCS: ref #4960
2018-08-17 09:17:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:17:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4960  77 58347 33459873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:17:40 [DEBUG   ] Got command RPT from MCS: ref #4962
2018-08-17 09:17:40 [DEBUG   ] summary = ERROR
2018-08-17 09:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4962  13 58347 33460077 A  ERRORERROR'
2018-08-17 09:17:40 [DEBUG   ] Got command RPT from MCS: ref #4963
2018-08-17 09:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4963  77 58347 33460281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:17:40 [DEBUG   ] Got command RPT from MCS: ref #4964
2018-08-17 09:17:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4964  12 58347 33460485 A  ERRORB“™š'
2018-08-17 09:17:49 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-17 09:18:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 09:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:18:13 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-08-17 09:18:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 09:18:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 09:19:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 09:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:19:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:19:13 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-17 09:19:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 09:19:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 09:20:03 [DEBUG   ] Got command RPT from MCS: ref #4965
2018-08-17 09:20:03 [DEBUG   ] summary = ERROR
2018-08-17 09:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4965  13 58347 33603657 A  ERRORERROR'
2018-08-17 09:20:03 [DEBUG   ] Got command RPT from MCS: ref #4966
2018-08-17 09:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4966  77 58347 33603658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:20:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 09:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:20:13 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-08-17 09:20:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 09:20:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 09:21:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 09:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:21:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 09:21:13 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-08-17 09:21:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 09:21:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 09:22:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 09:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:22:13 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-17 09:22:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 09:22:39 [DEBUG   ] Got command RPT from MCS: ref #4988
2018-08-17 09:22:39 [DEBUG   ] summary = ERROR
2018-08-17 09:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4988  13 58347 33759761 A  ERRORERROR'
2018-08-17 09:22:39 [DEBUG   ] Got command RPT from MCS: ref #4989
2018-08-17 09:22:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4989  77 58347 33759965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:22:40 [DEBUG   ] Got command RPT from MCS: ref #4990
2018-08-17 09:22:40 [DEBUG   ] summary = ERROR
2018-08-17 09:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4990  13 58347 33760169 A  ERRORERROR'
2018-08-17 09:22:40 [DEBUG   ] Got command RPT from MCS: ref #4991
2018-08-17 09:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4991  77 58347 33760361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:22:40 [DEBUG   ] Got command RPT from MCS: ref #4993
2018-08-17 09:22:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4993  12 58347 33760565 A  ERRORB“™š'
2018-08-17 09:22:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 09:23:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 09:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:23:13 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-08-17 09:23:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 09:23:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 09:24:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 09:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:24:13 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-08-17 09:24:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 09:24:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 09:25:03 [DEBUG   ] Got command RPT from MCS: ref #5002
2018-08-17 09:25:03 [DEBUG   ] summary = ERROR
2018-08-17 09:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5002  13 58347 33903661 A  ERRORERROR'
2018-08-17 09:25:03 [DEBUG   ] Got command RPT from MCS: ref #5003
2018-08-17 09:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5003  77 58347 33903662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:25:11 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-17 09:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:25:13 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-08-17 09:25:31 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-17 09:25:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 09:26:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 09:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:26:13 [DEBUG   ] Finished updating board flags in 1.348 seconds
2018-08-17 09:26:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 09:26:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 09:27:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 09:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:27:14 [DEBUG   ] Finished updating board flags in 2.073 seconds
2018-08-17 09:27:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 09:27:39 [DEBUG   ] Got command RPT from MCS: ref #5023
2018-08-17 09:27:39 [DEBUG   ] summary = ERROR
2018-08-17 09:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5023  13 58347 34059849 A  ERRORERROR'
2018-08-17 09:27:40 [DEBUG   ] Got command RPT from MCS: ref #5024
2018-08-17 09:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5024  77 58347 34060053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:27:40 [DEBUG   ] Got command RPT from MCS: ref #5025
2018-08-17 09:27:40 [DEBUG   ] summary = ERROR
2018-08-17 09:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5025  13 58347 34060245 A  ERRORERROR'
2018-08-17 09:27:40 [DEBUG   ] Got command RPT from MCS: ref #5026
2018-08-17 09:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5026  77 58347 34060449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:27:40 [DEBUG   ] Got command RPT from MCS: ref #5027
2018-08-17 09:27:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5027  12 58347 34060653 A  ERRORB“™š'
2018-08-17 09:27:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 09:28:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 09:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:28:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:28:14 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-08-17 09:28:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 09:28:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 09:29:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 09:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:29:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:29:14 [DEBUG   ] Finished updating board flags in 1.837 seconds
2018-08-17 09:29:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 09:29:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 09:30:03 [DEBUG   ] Got command RPT from MCS: ref #5032
2018-08-17 09:30:03 [DEBUG   ] summary = ERROR
2018-08-17 09:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5032  13 58347 34203661 A  ERRORERROR'
2018-08-17 09:30:03 [DEBUG   ] Got command RPT from MCS: ref #5033
2018-08-17 09:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5033  77 58347 34203662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:30:12 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 09:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:30:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:30:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 09:30:14 [DEBUG   ] Finished updating board flags in 1.776 seconds
2018-08-17 09:30:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-17 09:30:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 09:31:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 09:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:31:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:31:14 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-08-17 09:31:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 09:31:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 09:32:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 09:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:32:14 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-08-17 09:32:32 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-08-17 09:32:39 [DEBUG   ] Got command RPT from MCS: ref #5053
2018-08-17 09:32:39 [DEBUG   ] summary = ERROR
2018-08-17 09:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5053  13 58347 34359925 A  ERRORERROR'
2018-08-17 09:32:40 [DEBUG   ] Got command RPT from MCS: ref #5055
2018-08-17 09:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5055  77 58347 34360129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:32:40 [DEBUG   ] Got command RPT from MCS: ref #5057
2018-08-17 09:32:40 [DEBUG   ] summary = ERROR
2018-08-17 09:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5057  13 58347 34360333 A  ERRORERROR'
2018-08-17 09:32:40 [DEBUG   ] Got command RPT from MCS: ref #5058
2018-08-17 09:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5058  77 58347 34360537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:32:40 [DEBUG   ] Got command RPT from MCS: ref #5060
2018-08-17 09:32:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5060  12 58347 34360729 A  ERRORB“™š'
2018-08-17 09:32:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 09:33:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 09:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:33:14 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-08-17 09:33:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 09:33:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 09:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:34:13 [DEBUG   ] Finished updating ant stats in 1.214 seconds
2018-08-17 09:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:34:14 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-08-17 09:34:33 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-08-17 09:34:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 09:35:03 [DEBUG   ] Got command RPT from MCS: ref #5065
2018-08-17 09:35:03 [DEBUG   ] summary = ERROR
2018-08-17 09:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5065  13 58347 34503657 A  ERRORERROR'
2018-08-17 09:35:03 [DEBUG   ] Got command RPT from MCS: ref #5066
2018-08-17 09:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5066  77 58347 34503658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:35:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 09:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:35:14 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-08-17 09:35:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 09:35:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 09:36:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 09:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:36:15 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-08-17 09:36:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 09:36:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 09:37:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 09:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:37:15 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-08-17 09:37:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 09:37:40 [DEBUG   ] Got command RPT from MCS: ref #5086
2018-08-17 09:37:40 [DEBUG   ] summary = ERROR
2018-08-17 09:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5086  13 58347 34660009 A  ERRORERROR'
2018-08-17 09:37:40 [DEBUG   ] Got command RPT from MCS: ref #5087
2018-08-17 09:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5087  77 58347 34660213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:37:40 [DEBUG   ] Got command RPT from MCS: ref #5088
2018-08-17 09:37:40 [DEBUG   ] summary = ERROR
2018-08-17 09:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5088  13 58347 34660417 A  ERRORERROR'
2018-08-17 09:37:40 [DEBUG   ] Got command RPT from MCS: ref #5089
2018-08-17 09:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5089  77 58347 34660621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:37:40 [DEBUG   ] Got command RPT from MCS: ref #5090
2018-08-17 09:37:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5090  12 58347 34660813 A  ERRORB’™š'
2018-08-17 09:37:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 09:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:38:14 [DEBUG   ] Finished updating ant stats in 1.253 seconds
2018-08-17 09:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:38:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:38:15 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-08-17 09:38:34 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2018-08-17 09:38:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 09:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:39:14 [DEBUG   ] Finished updating ant stats in 1.042 seconds
2018-08-17 09:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:39:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:39:15 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-08-17 09:39:34 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-08-17 09:39:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 09:40:03 [DEBUG   ] Got command RPT from MCS: ref #5095
2018-08-17 09:40:03 [DEBUG   ] summary = ERROR
2018-08-17 09:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5095  13 58347 34803665 A  ERRORERROR'
2018-08-17 09:40:03 [DEBUG   ] Got command RPT from MCS: ref #5096
2018-08-17 09:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5096  77 58347 34803666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:40:14 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-08-17 09:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:40:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:40:15 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-08-17 09:40:34 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2018-08-17 09:40:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 09:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:41:14 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2018-08-17 09:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:41:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:41:15 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-08-17 09:41:34 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2018-08-17 09:41:55 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-08-17 09:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:42:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:42:15 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2018-08-17 09:42:15 [DEBUG   ] Finished updating board flags in 1.659 seconds
2018-08-17 09:42:35 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2018-08-17 09:42:40 [DEBUG   ] Got command RPT from MCS: ref #5118
2018-08-17 09:42:40 [DEBUG   ] summary = ERROR
2018-08-17 09:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5118  13 58347 34960093 A  ERRORERROR'
2018-08-17 09:42:40 [DEBUG   ] Got command RPT from MCS: ref #5119
2018-08-17 09:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5119  77 58347 34960297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:42:40 [DEBUG   ] Got command RPT from MCS: ref #5120
2018-08-17 09:42:40 [DEBUG   ] summary = ERROR
2018-08-17 09:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5120  13 58347 34960501 A  ERRORERROR'
2018-08-17 09:42:40 [DEBUG   ] Got command RPT from MCS: ref #5121
2018-08-17 09:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5121  77 58347 34960705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:42:40 [DEBUG   ] Got command RPT from MCS: ref #5123
2018-08-17 09:42:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5123  12 58347 34960897 A  ERRORB“™š'
2018-08-17 09:42:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 09:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:43:15 [DEBUG   ] Finished updating ant stats in 0.841 seconds
2018-08-17 09:43:15 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-08-17 09:43:35 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-08-17 09:43:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 09:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:44:15 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2018-08-17 09:44:15 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-08-17 09:44:35 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-08-17 09:44:56 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-08-17 09:45:03 [DEBUG   ] Got command RPT from MCS: ref #5132
2018-08-17 09:45:03 [DEBUG   ] summary = ERROR
2018-08-17 09:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5132  13 58347 35103661 A  ERRORERROR'
2018-08-17 09:45:03 [DEBUG   ] Got command RPT from MCS: ref #5133
2018-08-17 09:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5133  77 58347 35103662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:45:15 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-08-17 09:45:16 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 09:45:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 09:45:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 09:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:46:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 09:46:16 [DEBUG   ] Finished updating board flags in 2.518 seconds
2018-08-17 09:46:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 09:46:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 09:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:47:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 09:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:47:17 [DEBUG   ] Finished updating board flags in 3.159 seconds
2018-08-17 09:47:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 09:47:40 [DEBUG   ] Got command RPT from MCS: ref #5151
2018-08-17 09:47:40 [DEBUG   ] summary = ERROR
2018-08-17 09:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5151  13 58347 35260189 A  ERRORERROR'
2018-08-17 09:47:40 [DEBUG   ] Got command RPT from MCS: ref #5153
2018-08-17 09:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5153  77 58347 35260381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:47:40 [DEBUG   ] Got command RPT from MCS: ref #5155
2018-08-17 09:47:40 [DEBUG   ] summary = ERROR
2018-08-17 09:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5155  13 58347 35260585 A  ERRORERROR'
2018-08-17 09:47:40 [DEBUG   ] Got command RPT from MCS: ref #5156
2018-08-17 09:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5156  77 58347 35260789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:47:40 [DEBUG   ] Got command RPT from MCS: ref #5157
2018-08-17 09:47:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5157  12 58347 35260993 A  ERRORB“™š'
2018-08-17 09:47:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 09:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:48:16 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-08-17 09:48:16 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-08-17 09:48:36 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-08-17 09:48:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 09:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:49:16 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-08-17 09:49:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 09:49:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 09:49:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 09:50:03 [DEBUG   ] Got command RPT from MCS: ref #5158
2018-08-17 09:50:03 [DEBUG   ] summary = ERROR
2018-08-17 09:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5158  13 58347 35403665 A  ERRORERROR'
2018-08-17 09:50:03 [DEBUG   ] Got command RPT from MCS: ref #5159
2018-08-17 09:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5159  77 58347 35403666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:50:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:50:16 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-08-17 09:50:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 09:50:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 09:50:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 09:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:51:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:51:16 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-08-17 09:51:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 09:51:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 09:51:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 09:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:52:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:52:16 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-08-17 09:52:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 09:52:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 09:52:40 [DEBUG   ] Got command RPT from MCS: ref #5181
2018-08-17 09:52:40 [DEBUG   ] summary = ERROR
2018-08-17 09:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5181  13 58347 35560265 A  ERRORERROR'
2018-08-17 09:52:40 [DEBUG   ] Got command RPT from MCS: ref #5182
2018-08-17 09:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5182  77 58347 35560469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:52:40 [DEBUG   ] Got command RPT from MCS: ref #5183
2018-08-17 09:52:40 [DEBUG   ] summary = ERROR
2018-08-17 09:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5183  13 58347 35560673 A  ERRORERROR'
2018-08-17 09:52:40 [DEBUG   ] Got command RPT from MCS: ref #5184
2018-08-17 09:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5184  77 58347 35560865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:52:41 [DEBUG   ] Got command RPT from MCS: ref #5186
2018-08-17 09:52:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5186  12 58347 35561069 A  ERRORB“™š'
2018-08-17 09:52:57 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-08-17 09:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:53:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:53:16 [DEBUG   ] Finished updating board flags in 1.837 seconds
2018-08-17 09:53:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 09:53:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 09:53:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 09:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:54:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:54:16 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-08-17 09:54:17 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-08-17 09:54:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 09:54:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 09:55:03 [DEBUG   ] Got command RPT from MCS: ref #5195
2018-08-17 09:55:03 [DEBUG   ] summary = ERROR
2018-08-17 09:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5195  13 58347 35703665 A  ERRORERROR'
2018-08-17 09:55:03 [DEBUG   ] Got command RPT from MCS: ref #5196
2018-08-17 09:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5196  77 58347 35703666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:55:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:55:16 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-08-17 09:55:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 09:55:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 09:55:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 09:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:56:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:56:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 09:56:16 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-08-17 09:56:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 09:56:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 09:56:58 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-08-17 09:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:57:16 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-17 09:57:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 09:57:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 09:57:40 [DEBUG   ] Got command RPT from MCS: ref #5216
2018-08-17 09:57:40 [DEBUG   ] summary = ERROR
2018-08-17 09:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5216  13 58347 35860357 A  ERRORERROR'
2018-08-17 09:57:40 [DEBUG   ] Got command RPT from MCS: ref #5217
2018-08-17 09:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5217  77 58347 35860549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:57:40 [DEBUG   ] Got command RPT from MCS: ref #5218
2018-08-17 09:57:40 [DEBUG   ] summary = ERROR
2018-08-17 09:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5218  13 58347 35860753 A  ERRORERROR'
2018-08-17 09:57:40 [DEBUG   ] Got command RPT from MCS: ref #5219
2018-08-17 09:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 09:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5219  77 58347 35860957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 09:57:41 [DEBUG   ] Got command RPT from MCS: ref #5220
2018-08-17 09:57:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 09:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5220  12 58347 35861161 A  ERRORB“™š'
2018-08-17 09:57:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 09:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:58:16 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-17 09:58:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 09:58:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 09:58:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 09:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 09:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 09:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 09:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 09:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 09:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 09:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 09:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 09:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 09:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 09:59:16 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-08-17 09:59:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 09:59:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 09:59:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 10:00:03 [DEBUG   ] Got command RPT from MCS: ref #5225
2018-08-17 10:00:03 [DEBUG   ] summary = ERROR
2018-08-17 10:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5225  13 58347 36003666 A  ERRORERROR'
2018-08-17 10:00:03 [DEBUG   ] Got command RPT from MCS: ref #5226
2018-08-17 10:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5226  77 58347 36003666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:00:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 10:00:16 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-08-17 10:00:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 10:00:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 10:00:59 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 10:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:01:16 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-08-17 10:01:19 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 10:01:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 10:01:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:02:16 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-08-17 10:02:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:02:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:02:40 [DEBUG   ] Got command RPT from MCS: ref #5246
2018-08-17 10:02:40 [DEBUG   ] summary = ERROR
2018-08-17 10:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5246  13 58347 36160434 A  ERRORERROR'
2018-08-17 10:02:40 [DEBUG   ] Got command RPT from MCS: ref #5248
2018-08-17 10:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5248  77 58347 36160637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:02:40 [DEBUG   ] Got command RPT from MCS: ref #5250
2018-08-17 10:02:40 [DEBUG   ] summary = ERROR
2018-08-17 10:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5250  13 58347 36160841 A  ERRORERROR'
2018-08-17 10:02:41 [DEBUG   ] Got command RPT from MCS: ref #5251
2018-08-17 10:02:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5251  77 58347 36161034 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:02:41 [DEBUG   ] Got command RPT from MCS: ref #5253
2018-08-17 10:02:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5253  12 58347 36161237 A  ERRORB“™š'
2018-08-17 10:02:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 10:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:03:16 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-08-17 10:03:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 10:03:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 10:03:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 10:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:04:16 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-08-17 10:04:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:04:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:04:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 10:05:03 [DEBUG   ] Got command RPT from MCS: ref #5258
2018-08-17 10:05:03 [DEBUG   ] summary = ERROR
2018-08-17 10:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5258  13 58347 36303673 A  ERRORERROR'
2018-08-17 10:05:03 [DEBUG   ] Got command RPT from MCS: ref #5259
2018-08-17 10:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5259  77 58347 36303674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:05:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:05:17 [DEBUG   ] Finished updating board flags in 2.283 seconds
2018-08-17 10:05:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 10:05:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:05:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:06:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:06:17 [DEBUG   ] Finished updating board flags in 2.154 seconds
2018-08-17 10:06:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 10:06:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 10:06:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 10:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:07:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:07:17 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-08-17 10:07:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 10:07:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 10:07:40 [DEBUG   ] Got command RPT from MCS: ref #5279
2018-08-17 10:07:40 [DEBUG   ] summary = ERROR
2018-08-17 10:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5279  13 58347 36460525 A  ERRORERROR'
2018-08-17 10:07:40 [DEBUG   ] Got command RPT from MCS: ref #5280
2018-08-17 10:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5280  77 58347 36460718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:07:40 [DEBUG   ] Got command RPT from MCS: ref #5281
2018-08-17 10:07:40 [DEBUG   ] summary = ERROR
2018-08-17 10:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5281  13 58347 36460921 A  ERRORERROR'
2018-08-17 10:07:41 [DEBUG   ] Got command RPT from MCS: ref #5282
2018-08-17 10:07:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5282  77 58347 36461125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:07:41 [DEBUG   ] Got command RPT from MCS: ref #5283
2018-08-17 10:07:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5283  12 58347 36461318 A  ERRORB“™š'
2018-08-17 10:07:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 10:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:08:17 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-08-17 10:08:19 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-08-17 10:08:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 10:08:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-08-17 10:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:09:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 10:09:17 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-08-17 10:09:20 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-17 10:09:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 10:10:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 10:10:03 [DEBUG   ] Got command RPT from MCS: ref #5288
2018-08-17 10:10:03 [DEBUG   ] summary = ERROR
2018-08-17 10:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5288  13 58347 36603669 A  ERRORERROR'
2018-08-17 10:10:03 [DEBUG   ] Got command RPT from MCS: ref #5289
2018-08-17 10:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5289  77 58347 36603670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:10:17 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-08-17 10:10:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 10:10:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:11:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:11:17 [DEBUG   ] Finished updating board flags in 1.577 seconds
2018-08-17 10:11:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 10:11:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 10:12:00 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 10:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:12:17 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-08-17 10:12:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 10:12:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 10:12:40 [DEBUG   ] Got command RPT from MCS: ref #5311
2018-08-17 10:12:40 [DEBUG   ] summary = ERROR
2018-08-17 10:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5311  13 58347 36760609 A  ERRORERROR'
2018-08-17 10:12:40 [DEBUG   ] Got command RPT from MCS: ref #5312
2018-08-17 10:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5312  77 58347 36760801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:12:41 [DEBUG   ] Got command RPT from MCS: ref #5313
2018-08-17 10:12:41 [DEBUG   ] summary = ERROR
2018-08-17 10:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5313  13 58347 36761005 A  ERRORERROR'
2018-08-17 10:12:41 [DEBUG   ] Got command RPT from MCS: ref #5314
2018-08-17 10:12:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5314  77 58347 36761209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:12:41 [DEBUG   ] Got command RPT from MCS: ref #5316
2018-08-17 10:12:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5316  12 58347 36761413 A  ERRORB“™š'
2018-08-17 10:13:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 10:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:13:17 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-08-17 10:13:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 10:13:41 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-08-17 10:14:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:14:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 10:14:17 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-08-17 10:14:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 10:14:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:15:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 10:15:03 [DEBUG   ] Got command RPT from MCS: ref #5325
2018-08-17 10:15:03 [DEBUG   ] summary = ERROR
2018-08-17 10:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5325  13 58347 36903673 A  ERRORERROR'
2018-08-17 10:15:03 [DEBUG   ] Got command RPT from MCS: ref #5326
2018-08-17 10:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5326  77 58347 36903674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:15:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:15:18 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-08-17 10:15:21 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-17 10:15:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 10:16:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-08-17 10:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:16:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:16:18 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-08-17 10:16:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 10:16:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 10:17:01 [DEBUG   ] Finished updating ant stats in 0.875 seconds
2018-08-17 10:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:17:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:17:18 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-08-17 10:17:21 [DEBUG   ] Finished updating ant stats in 0.732 seconds
2018-08-17 10:17:40 [DEBUG   ] Got command RPT from MCS: ref #5344
2018-08-17 10:17:40 [DEBUG   ] summary = ERROR
2018-08-17 10:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5344  13 58347 37060685 A  ERRORERROR'
2018-08-17 10:17:40 [DEBUG   ] Got command RPT from MCS: ref #5346
2018-08-17 10:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5346  77 58347 37060890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:17:41 [DEBUG   ] Got command RPT from MCS: ref #5348
2018-08-17 10:17:41 [DEBUG   ] summary = ERROR
2018-08-17 10:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5348  13 58347 37061089 A  ERRORERROR'
2018-08-17 10:17:41 [DEBUG   ] Got command RPT from MCS: ref #5349
2018-08-17 10:17:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5349  77 58347 37061293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:17:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 10:17:41 [DEBUG   ] Got command RPT from MCS: ref #5350
2018-08-17 10:17:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5350  12 58347 37061497 A  ERRORB“™š'
2018-08-17 10:18:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 10:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:18:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:18:18 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-08-17 10:18:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 10:18:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 10:19:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-08-17 10:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:19:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:19:18 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-08-17 10:19:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 10:19:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 10:20:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 10:20:03 [DEBUG   ] Got command RPT from MCS: ref #5351
2018-08-17 10:20:03 [DEBUG   ] summary = ERROR
2018-08-17 10:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5351  13 58347 37203673 A  ERRORERROR'
2018-08-17 10:20:03 [DEBUG   ] Got command RPT from MCS: ref #5352
2018-08-17 10:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5352  77 58347 37203674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:20:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:20:18 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-08-17 10:20:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 10:20:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 10:21:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 10:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:21:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:21:18 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-08-17 10:21:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 10:21:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 10:22:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:22:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:22:18 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-08-17 10:22:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 10:22:40 [DEBUG   ] Got command RPT from MCS: ref #5374
2018-08-17 10:22:40 [DEBUG   ] summary = ERROR
2018-08-17 10:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5374  13 58347 37360773 A  ERRORERROR'
2018-08-17 10:22:40 [DEBUG   ] Got command RPT from MCS: ref #5375
2018-08-17 10:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5375  77 58347 37360977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:22:41 [DEBUG   ] Got command RPT from MCS: ref #5376
2018-08-17 10:22:41 [DEBUG   ] summary = ERROR
2018-08-17 10:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5376  13 58347 37361181 A  ERRORERROR'
2018-08-17 10:22:41 [DEBUG   ] Got command RPT from MCS: ref #5377
2018-08-17 10:22:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5377  77 58347 37361374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:22:41 [DEBUG   ] Got command RPT from MCS: ref #5379
2018-08-17 10:22:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5379  12 58347 37361577 A  ERRORB“™š'
2018-08-17 10:22:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 10:23:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 10:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:23:18 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-08-17 10:23:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 10:23:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 10:24:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 10:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:24:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:24:19 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-08-17 10:24:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 10:24:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 10:25:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 10:25:03 [DEBUG   ] Got command RPT from MCS: ref #5388
2018-08-17 10:25:03 [DEBUG   ] summary = ERROR
2018-08-17 10:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5388  13 58347 37503681 A  ERRORERROR'
2018-08-17 10:25:03 [DEBUG   ] Got command RPT from MCS: ref #5389
2018-08-17 10:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5389  77 58347 37503682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:25:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:25:19 [DEBUG   ] Finished updating board flags in 2.101 seconds
2018-08-17 10:25:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 10:25:42 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-08-17 10:26:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:26:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:26:19 [DEBUG   ] Finished updating board flags in 1.887 seconds
2018-08-17 10:26:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:26:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 10:27:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 10:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:27:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:27:19 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-08-17 10:27:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:27:40 [DEBUG   ] Got command RPT from MCS: ref #5409
2018-08-17 10:27:40 [DEBUG   ] summary = ERROR
2018-08-17 10:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5409  13 58347 37660865 A  ERRORERROR'
2018-08-17 10:27:41 [DEBUG   ] Got command RPT from MCS: ref #5410
2018-08-17 10:27:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5410  77 58347 37661057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:27:41 [DEBUG   ] Got command RPT from MCS: ref #5411
2018-08-17 10:27:41 [DEBUG   ] summary = ERROR
2018-08-17 10:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5411  13 58347 37661261 A  ERRORERROR'
2018-08-17 10:27:41 [DEBUG   ] Got command RPT from MCS: ref #5412
2018-08-17 10:27:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5412  77 58347 37661465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:27:41 [DEBUG   ] Got command RPT from MCS: ref #5413
2018-08-17 10:27:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5413  12 58347 37661669 A  ERRORB“™š'
2018-08-17 10:27:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:28:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 10:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:28:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:28:19 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-08-17 10:28:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:28:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:29:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:29:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:29:19 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-08-17 10:29:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 10:29:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:30:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:30:03 [DEBUG   ] Got command RPT from MCS: ref #5418
2018-08-17 10:30:03 [DEBUG   ] summary = ERROR
2018-08-17 10:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5418  13 58347 37803673 A  ERRORERROR'
2018-08-17 10:30:03 [DEBUG   ] Got command RPT from MCS: ref #5419
2018-08-17 10:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5419  77 58347 37803674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:30:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:30:19 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-08-17 10:30:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:30:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 10:31:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:31:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:31:19 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-08-17 10:31:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:31:43 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 10:32:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:32:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:32:20 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-17 10:32:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:32:40 [DEBUG   ] Got command RPT from MCS: ref #5439
2018-08-17 10:32:40 [DEBUG   ] summary = ERROR
2018-08-17 10:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5439  13 58347 37960945 A  ERRORERROR'
2018-08-17 10:32:41 [DEBUG   ] Got command RPT from MCS: ref #5441
2018-08-17 10:32:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5441  77 58347 37961149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:32:41 [DEBUG   ] Got command RPT from MCS: ref #5443
2018-08-17 10:32:41 [DEBUG   ] summary = ERROR
2018-08-17 10:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5443  13 58347 37961342 A  ERRORERROR'
2018-08-17 10:32:41 [DEBUG   ] Got command RPT from MCS: ref #5444
2018-08-17 10:32:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5444  77 58347 37961545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:32:41 [DEBUG   ] Got command RPT from MCS: ref #5446
2018-08-17 10:32:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5446  12 58347 37961750 A  ERRORB“™š'
2018-08-17 10:32:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 10:33:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 10:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:33:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:33:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:33:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 10:33:20 [DEBUG   ] Finished updating board flags in 2.135 seconds
2018-08-17 10:33:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 10:33:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 10:34:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 10:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:34:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:34:20 [DEBUG   ] Finished updating board flags in 1.902 seconds
2018-08-17 10:34:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 10:34:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 10:35:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 10:35:03 [DEBUG   ] Got command RPT from MCS: ref #5451
2018-08-17 10:35:03 [DEBUG   ] summary = ERROR
2018-08-17 10:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5451  13 58347 38103681 A  ERRORERROR'
2018-08-17 10:35:03 [DEBUG   ] Got command RPT from MCS: ref #5452
2018-08-17 10:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5452  77 58347 38103682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:35:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:35:20 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-08-17 10:35:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 10:35:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 10:36:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 10:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:36:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 10:36:20 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-08-17 10:36:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 10:36:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 10:37:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 10:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:37:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:37:20 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-08-17 10:37:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 10:37:41 [DEBUG   ] Got command RPT from MCS: ref #5472
2018-08-17 10:37:41 [DEBUG   ] summary = ERROR
2018-08-17 10:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5472  13 58347 38261025 A  ERRORERROR'
2018-08-17 10:37:41 [DEBUG   ] Got command RPT from MCS: ref #5473
2018-08-17 10:37:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5473  77 58347 38261229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:37:41 [DEBUG   ] Got command RPT from MCS: ref #5474
2018-08-17 10:37:41 [DEBUG   ] summary = ERROR
2018-08-17 10:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5474  13 58347 38261433 A  ERRORERROR'
2018-08-17 10:37:41 [DEBUG   ] Got command RPT from MCS: ref #5475
2018-08-17 10:37:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5475  77 58347 38261625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:37:41 [DEBUG   ] Got command RPT from MCS: ref #5476
2018-08-17 10:37:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:37:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5476  12 58347 38261829 A  ERRORB“™š'
2018-08-17 10:37:44 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-08-17 10:38:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 10:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:38:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:38:20 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-08-17 10:38:24 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 10:38:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:39:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:39:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:39:20 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-08-17 10:39:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 10:39:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 10:40:03 [DEBUG   ] Got command RPT from MCS: ref #5481
2018-08-17 10:40:03 [DEBUG   ] summary = ERROR
2018-08-17 10:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5481  13 58347 38403682 A  ERRORERROR'
2018-08-17 10:40:03 [DEBUG   ] Got command RPT from MCS: ref #5482
2018-08-17 10:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5482  77 58347 38403682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:40:04 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-08-17 10:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:40:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:40:20 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-08-17 10:40:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 10:40:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 10:41:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 10:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:41:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:41:20 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-08-17 10:41:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 10:41:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 10:42:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 10:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:42:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:42:20 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-08-17 10:42:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 10:42:41 [DEBUG   ] Got command RPT from MCS: ref #5504
2018-08-17 10:42:41 [DEBUG   ] summary = ERROR
2018-08-17 10:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5504  13 58347 38561113 A  ERRORERROR'
2018-08-17 10:42:41 [DEBUG   ] Got command RPT from MCS: ref #5505
2018-08-17 10:42:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5505  77 58347 38561317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:42:41 [DEBUG   ] Got command RPT from MCS: ref #5506
2018-08-17 10:42:41 [DEBUG   ] summary = ERROR
2018-08-17 10:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5506  13 58347 38561509 A  ERRORERROR'
2018-08-17 10:42:41 [DEBUG   ] Got command RPT from MCS: ref #5507
2018-08-17 10:42:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5507  77 58347 38561713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:42:41 [DEBUG   ] Got command RPT from MCS: ref #5509
2018-08-17 10:42:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:42:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5509  12 58347 38561917 A  ERRORB“™š'
2018-08-17 10:42:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 10:43:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 10:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:43:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:43:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:43:21 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-08-17 10:43:25 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 10:43:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 10:44:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 10:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:44:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:44:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:44:21 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-08-17 10:44:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 10:44:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:45:03 [DEBUG   ] Got command RPT from MCS: ref #5518
2018-08-17 10:45:03 [DEBUG   ] summary = ERROR
2018-08-17 10:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5518  13 58347 38703685 A  ERRORERROR'
2018-08-17 10:45:03 [DEBUG   ] Got command RPT from MCS: ref #5519
2018-08-17 10:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5519  77 58347 38703686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:45:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 10:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:45:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:45:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:45:21 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-08-17 10:45:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 10:45:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 10:46:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 10:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:46:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:46:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:46:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 10:46:21 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-08-17 10:46:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 10:46:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 10:47:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 10:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:47:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:47:21 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-08-17 10:47:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 10:47:41 [DEBUG   ] Got command RPT from MCS: ref #5537
2018-08-17 10:47:41 [DEBUG   ] summary = ERROR
2018-08-17 10:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5537  13 58347 38861193 A  ERRORERROR'
2018-08-17 10:47:41 [DEBUG   ] Got command RPT from MCS: ref #5539
2018-08-17 10:47:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5539  77 58347 38861397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:47:41 [DEBUG   ] Got command RPT from MCS: ref #5541
2018-08-17 10:47:41 [DEBUG   ] summary = ERROR
2018-08-17 10:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5541  13 58347 38861601 A  ERRORERROR'
2018-08-17 10:47:41 [DEBUG   ] Got command RPT from MCS: ref #5542
2018-08-17 10:47:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5542  77 58347 38861805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:47:41 [DEBUG   ] Got command RPT from MCS: ref #5543
2018-08-17 10:47:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:47:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5543  12 58347 38861997 A  ERRORB“™š'
2018-08-17 10:47:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 10:48:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 10:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:48:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:48:21 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-08-17 10:48:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 10:48:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 10:49:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 10:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:49:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:49:21 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-17 10:49:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 10:49:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 10:50:03 [DEBUG   ] Got command RPT from MCS: ref #5544
2018-08-17 10:50:03 [DEBUG   ] summary = ERROR
2018-08-17 10:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5544  13 58347 39003677 A  ERRORERROR'
2018-08-17 10:50:03 [DEBUG   ] Got command RPT from MCS: ref #5545
2018-08-17 10:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5545  77 58347 39003678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:50:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-08-17 10:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:50:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:50:21 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-08-17 10:50:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 10:50:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 10:51:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 10:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:51:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:51:21 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-08-17 10:51:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 10:51:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 10:52:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 10:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:52:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:52:22 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-08-17 10:52:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 10:52:41 [DEBUG   ] Got command RPT from MCS: ref #5567
2018-08-17 10:52:41 [DEBUG   ] summary = ERROR
2018-08-17 10:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5567  13 58347 39161281 A  ERRORERROR'
2018-08-17 10:52:41 [DEBUG   ] Got command RPT from MCS: ref #5568
2018-08-17 10:52:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5568  77 58347 39161485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:52:41 [DEBUG   ] Got command RPT from MCS: ref #5569
2018-08-17 10:52:41 [DEBUG   ] summary = ERROR
2018-08-17 10:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5569  13 58347 39161689 A  ERRORERROR'
2018-08-17 10:52:41 [DEBUG   ] Got command RPT from MCS: ref #5570
2018-08-17 10:52:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:52:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5570  77 58347 39161881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:52:42 [DEBUG   ] Got command RPT from MCS: ref #5572
2018-08-17 10:52:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:52:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5572  12 58347 39162085 A  ERRORB“™š'
2018-08-17 10:52:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 10:53:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 10:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:53:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:53:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:53:22 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-08-17 10:53:26 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 10:53:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 10:54:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 10:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:54:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:54:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:54:22 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-08-17 10:54:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 10:54:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 10:55:03 [DEBUG   ] Got command RPT from MCS: ref #5581
2018-08-17 10:55:03 [DEBUG   ] summary = ERROR
2018-08-17 10:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5581  13 58347 39303685 A  ERRORERROR'
2018-08-17 10:55:03 [DEBUG   ] Got command RPT from MCS: ref #5582
2018-08-17 10:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5582  77 58347 39303686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:55:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 10:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:55:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:55:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:55:22 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-08-17 10:55:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 10:55:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 10:56:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 10:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:56:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:56:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:56:22 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-08-17 10:56:27 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-17 10:56:48 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 10:57:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:57:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:57:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:57:22 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-08-17 10:57:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 10:57:41 [DEBUG   ] Got command RPT from MCS: ref #5602
2018-08-17 10:57:41 [DEBUG   ] summary = ERROR
2018-08-17 10:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5602  13 58347 39461373 A  ERRORERROR'
2018-08-17 10:57:41 [DEBUG   ] Got command RPT from MCS: ref #5603
2018-08-17 10:57:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5603  77 58347 39461565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:57:41 [DEBUG   ] Got command RPT from MCS: ref #5604
2018-08-17 10:57:41 [DEBUG   ] summary = ERROR
2018-08-17 10:57:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5604  13 58347 39461770 A  ERRORERROR'
2018-08-17 10:57:41 [DEBUG   ] Got command RPT from MCS: ref #5605
2018-08-17 10:57:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 10:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5605  77 58347 39462019 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 10:57:42 [DEBUG   ] Got command RPT from MCS: ref #5606
2018-08-17 10:57:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 10:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5606  12 58347 39462173 A  ERRORB“™š'
2018-08-17 10:57:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 10:58:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 10:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:58:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:58:22 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-08-17 10:58:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 10:58:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 10:59:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 10:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 10:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 10:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 10:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 10:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 10:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 10:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 10:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 10:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 10:59:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 10:59:22 [DEBUG   ] Finished updating board flags in 1.539 seconds
2018-08-17 10:59:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 10:59:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:00:03 [DEBUG   ] Got command RPT from MCS: ref #5611
2018-08-17 11:00:03 [DEBUG   ] summary = ERROR
2018-08-17 11:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5611  13 58347 39603681 A  ERRORERROR'
2018-08-17 11:00:03 [DEBUG   ] Got command RPT from MCS: ref #5612
2018-08-17 11:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5612  77 58347 39603682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:00:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 11:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:00:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:00:23 [DEBUG   ] Finished updating board flags in 2.290 seconds
2018-08-17 11:00:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:00:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 11:01:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:01:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:01:23 [DEBUG   ] Finished updating board flags in 2.085 seconds
2018-08-17 11:01:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 11:01:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 11:02:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:02:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:02:23 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-08-17 11:02:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 11:02:41 [DEBUG   ] Got command RPT from MCS: ref #5632
2018-08-17 11:02:41 [DEBUG   ] summary = ERROR
2018-08-17 11:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5632  13 58347 39761449 A  ERRORERROR'
2018-08-17 11:02:41 [DEBUG   ] Got command RPT from MCS: ref #5634
2018-08-17 11:02:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5634  77 58347 39761653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:02:41 [DEBUG   ] Got command RPT from MCS: ref #5636
2018-08-17 11:02:41 [DEBUG   ] summary = ERROR
2018-08-17 11:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5636  13 58347 39761857 A  ERRORERROR'
2018-08-17 11:02:42 [DEBUG   ] Got command RPT from MCS: ref #5637
2018-08-17 11:02:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:02:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5637  77 58347 39762061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:02:42 [DEBUG   ] Got command RPT from MCS: ref #5639
2018-08-17 11:02:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:02:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5639  12 58347 39762253 A  ERRORB“™š'
2018-08-17 11:02:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 11:03:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 11:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:03:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:03:23 [DEBUG   ] Finished updating board flags in 1.962 seconds
2018-08-17 11:03:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:03:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:04:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 11:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:04:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:04:23 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-08-17 11:04:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 11:04:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 11:05:03 [DEBUG   ] Got command RPT from MCS: ref #5644
2018-08-17 11:05:03 [DEBUG   ] summary = ERROR
2018-08-17 11:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5644  13 58347 39903685 A  ERRORERROR'
2018-08-17 11:05:03 [DEBUG   ] Got command RPT from MCS: ref #5645
2018-08-17 11:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5645  77 58347 39903686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:05:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 11:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:05:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:05:23 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-08-17 11:05:28 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-08-17 11:05:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:06:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 11:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:06:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:06:23 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-08-17 11:06:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 11:06:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:07:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 11:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:07:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:07:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 11:07:23 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-08-17 11:07:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 11:07:41 [DEBUG   ] Got command RPT from MCS: ref #5665
2018-08-17 11:07:41 [DEBUG   ] summary = ERROR
2018-08-17 11:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5665  13 58347 40061533 A  ERRORERROR'
2018-08-17 11:07:41 [DEBUG   ] Got command RPT from MCS: ref #5666
2018-08-17 11:07:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5666  77 58347 40061749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:07:41 [DEBUG   ] Got command RPT from MCS: ref #5667
2018-08-17 11:07:41 [DEBUG   ] summary = ERROR
2018-08-17 11:07:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5667  13 58347 40061967 A  ERRORERROR'
2018-08-17 11:07:42 [DEBUG   ] Got command RPT from MCS: ref #5668
2018-08-17 11:07:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5668  77 58347 40062145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:07:42 [DEBUG   ] Got command RPT from MCS: ref #5669
2018-08-17 11:07:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5669  12 58347 40062337 A  ERRORB“™š'
2018-08-17 11:07:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 11:08:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 11:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:08:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:08:23 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-08-17 11:08:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:08:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 11:09:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 11:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:09:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:09:23 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-08-17 11:09:29 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 11:09:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 11:10:03 [DEBUG   ] Got command RPT from MCS: ref #5674
2018-08-17 11:10:03 [DEBUG   ] summary = ERROR
2018-08-17 11:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5674  13 58347 40203686 A  ERRORERROR'
2018-08-17 11:10:03 [DEBUG   ] Got command RPT from MCS: ref #5675
2018-08-17 11:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5675  77 58347 40203686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:10:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 11:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:10:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:10:23 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-08-17 11:10:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-08-17 11:10:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 11:11:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 11:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:11:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:11:24 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-08-17 11:11:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:11:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:12:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:12:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:12:24 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-08-17 11:12:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 11:12:41 [DEBUG   ] Got command RPT from MCS: ref #5697
2018-08-17 11:12:41 [DEBUG   ] summary = ERROR
2018-08-17 11:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5697  13 58347 40361621 A  ERRORERROR'
2018-08-17 11:12:41 [DEBUG   ] Got command RPT from MCS: ref #5698
2018-08-17 11:12:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:12:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5698  77 58347 40361826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:12:42 [DEBUG   ] Got command RPT from MCS: ref #5699
2018-08-17 11:12:42 [DEBUG   ] summary = ERROR
2018-08-17 11:12:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5699  13 58347 40362030 A  ERRORERROR'
2018-08-17 11:12:42 [DEBUG   ] Got command RPT from MCS: ref #5700
2018-08-17 11:12:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:12:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5700  77 58347 40362221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:12:42 [DEBUG   ] Got command RPT from MCS: ref #5702
2018-08-17 11:12:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:12:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5702  12 58347 40362425 A  ERRORB“™š'
2018-08-17 11:12:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-08-17 11:13:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:13:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:13:24 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-08-17 11:13:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:13:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 11:14:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 11:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:14:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:14:24 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-08-17 11:14:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:14:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:15:03 [DEBUG   ] Got command RPT from MCS: ref #5711
2018-08-17 11:15:03 [DEBUG   ] summary = ERROR
2018-08-17 11:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5711  13 58347 40503685 A  ERRORERROR'
2018-08-17 11:15:03 [DEBUG   ] Got command RPT from MCS: ref #5712
2018-08-17 11:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5712  77 58347 40503686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:15:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 11:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:15:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:15:24 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-08-17 11:15:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 11:15:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 11:16:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 11:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:16:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:16:24 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-08-17 11:16:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-08-17 11:16:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 11:17:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 11:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:17:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 11:17:24 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-08-17 11:17:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 11:17:41 [DEBUG   ] Got command RPT from MCS: ref #5730
2018-08-17 11:17:41 [DEBUG   ] summary = ERROR
2018-08-17 11:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5730  13 58347 40661713 A  ERRORERROR'
2018-08-17 11:17:41 [DEBUG   ] Got command RPT from MCS: ref #5732
2018-08-17 11:17:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:17:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5732  77 58347 40661918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:17:42 [DEBUG   ] Got command RPT from MCS: ref #5734
2018-08-17 11:17:42 [DEBUG   ] summary = ERROR
2018-08-17 11:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5734  13 58347 40662109 A  ERRORERROR'
2018-08-17 11:17:42 [DEBUG   ] Got command RPT from MCS: ref #5735
2018-08-17 11:17:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5735  77 58347 40662313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:17:42 [DEBUG   ] Got command RPT from MCS: ref #5736
2018-08-17 11:17:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5736  12 58347 40662518 A  ERRORB“™š'
2018-08-17 11:17:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 11:18:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 11:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:18:24 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-08-17 11:18:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 11:18:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 11:19:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 11:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:19:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:19:24 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-08-17 11:19:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 11:19:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 11:20:03 [DEBUG   ] Got command RPT from MCS: ref #5737
2018-08-17 11:20:03 [DEBUG   ] summary = ERROR
2018-08-17 11:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5737  13 58347 40803689 A  ERRORERROR'
2018-08-17 11:20:03 [DEBUG   ] Got command RPT from MCS: ref #5738
2018-08-17 11:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5738  77 58347 40803690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:20:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 11:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:20:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:20:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 11:20:24 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-08-17 11:20:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 11:20:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:21:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:21:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:21:24 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-08-17 11:21:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 11:21:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 11:22:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:22:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:22:24 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-08-17 11:22:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:22:41 [DEBUG   ] Got command RPT from MCS: ref #5760
2018-08-17 11:22:41 [DEBUG   ] summary = ERROR
2018-08-17 11:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5760  13 58347 40961797 A  ERRORERROR'
2018-08-17 11:22:41 [DEBUG   ] Got command RPT from MCS: ref #5761
2018-08-17 11:22:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:22:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5761  77 58347 40961993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:22:42 [DEBUG   ] Got command RPT from MCS: ref #5762
2018-08-17 11:22:42 [DEBUG   ] summary = ERROR
2018-08-17 11:22:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5762  13 58347 40962197 A  ERRORERROR'
2018-08-17 11:22:42 [DEBUG   ] Got command RPT from MCS: ref #5763
2018-08-17 11:22:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:22:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5763  77 58347 40962410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:22:42 [DEBUG   ] Got command RPT from MCS: ref #5765
2018-08-17 11:22:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:22:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5765  12 58347 40962601 A  ERRORB“™š'
2018-08-17 11:22:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-08-17 11:23:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:23:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:23:25 [DEBUG   ] Finished updating board flags in 2.283 seconds
2018-08-17 11:23:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:23:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 11:24:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 11:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:24:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:24:25 [DEBUG   ] Finished updating board flags in 2.070 seconds
2018-08-17 11:24:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:24:51 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 11:25:03 [DEBUG   ] Got command RPT from MCS: ref #5774
2018-08-17 11:25:03 [DEBUG   ] summary = ERROR
2018-08-17 11:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5774  13 58347 41103689 A  ERRORERROR'
2018-08-17 11:25:03 [DEBUG   ] Got command RPT from MCS: ref #5775
2018-08-17 11:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5775  77 58347 41103690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:25:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 11:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:25:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:25:25 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-08-17 11:25:32 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 11:25:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 11:26:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:26:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:26:25 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-08-17 11:26:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 11:26:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:27:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:27:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:27:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 11:27:25 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-08-17 11:27:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:27:41 [DEBUG   ] Got command RPT from MCS: ref #5795
2018-08-17 11:27:41 [DEBUG   ] summary = ERROR
2018-08-17 11:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5795  13 58347 41261889 A  ERRORERROR'
2018-08-17 11:27:42 [DEBUG   ] Got command RPT from MCS: ref #5796
2018-08-17 11:27:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:27:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5796  77 58347 41262093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:27:42 [DEBUG   ] Got command RPT from MCS: ref #5797
2018-08-17 11:27:42 [DEBUG   ] summary = ERROR
2018-08-17 11:27:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5797  13 58347 41262285 A  ERRORERROR'
2018-08-17 11:27:42 [DEBUG   ] Got command RPT from MCS: ref #5798
2018-08-17 11:27:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:27:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5798  77 58347 41262489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:27:42 [DEBUG   ] Got command RPT from MCS: ref #5799
2018-08-17 11:27:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:27:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5799  12 58347 41262693 A  ERRORB“™š'
2018-08-17 11:27:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 11:28:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:28:25 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-08-17 11:28:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:28:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 11:29:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:29:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:29:25 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-08-17 11:29:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 11:29:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:30:03 [DEBUG   ] Got command RPT from MCS: ref #5804
2018-08-17 11:30:03 [DEBUG   ] summary = ERROR
2018-08-17 11:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5804  13 58347 41403685 A  ERRORERROR'
2018-08-17 11:30:03 [DEBUG   ] Got command RPT from MCS: ref #5805
2018-08-17 11:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5805  77 58347 41403686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:30:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:30:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:30:25 [DEBUG   ] Finished updating board flags in 1.649 seconds
2018-08-17 11:30:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 11:30:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:31:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 11:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:31:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:31:25 [DEBUG   ] Finished updating board flags in 1.552 seconds
2018-08-17 11:31:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 11:31:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 11:32:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:32:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:32:25 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-08-17 11:32:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:32:41 [DEBUG   ] Got command RPT from MCS: ref #5825
2018-08-17 11:32:41 [DEBUG   ] summary = ERROR
2018-08-17 11:32:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5825  13 58347 41561973 A  ERRORERROR'
2018-08-17 11:32:42 [DEBUG   ] Got command RPT from MCS: ref #5827
2018-08-17 11:32:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:32:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5827  77 58347 41562177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:32:42 [DEBUG   ] Got command RPT from MCS: ref #5829
2018-08-17 11:32:42 [DEBUG   ] summary = ERROR
2018-08-17 11:32:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5829  13 58347 41562369 A  ERRORERROR'
2018-08-17 11:32:42 [DEBUG   ] Got command RPT from MCS: ref #5830
2018-08-17 11:32:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:32:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5830  77 58347 41562573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:32:42 [DEBUG   ] Got command RPT from MCS: ref #5832
2018-08-17 11:32:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:32:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5832  12 58347 41562777 A  ERRORB“™š'
2018-08-17 11:32:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:33:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 11:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:33:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:33:25 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-08-17 11:33:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 11:33:52 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 11:34:13 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-08-17 11:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:34:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:34:25 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-08-17 11:34:33 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-08-17 11:34:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:35:03 [DEBUG   ] Got command RPT from MCS: ref #5837
2018-08-17 11:35:03 [DEBUG   ] summary = ERROR
2018-08-17 11:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5837  13 58347 41703685 A  ERRORERROR'
2018-08-17 11:35:03 [DEBUG   ] Got command RPT from MCS: ref #5838
2018-08-17 11:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5838  77 58347 41703686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:35:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 11:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:35:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:35:25 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-08-17 11:35:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 11:35:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 11:36:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:36:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-08-17 11:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:36:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:36:25 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-08-17 11:36:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 11:36:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 11:37:13 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-17 11:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:37:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:37:26 [DEBUG   ] Finished updating board flags in 2.231 seconds
2018-08-17 11:37:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:37:42 [DEBUG   ] Got command RPT from MCS: ref #5858
2018-08-17 11:37:42 [DEBUG   ] summary = ERROR
2018-08-17 11:37:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5858  13 58347 41862061 A  ERRORERROR'
2018-08-17 11:37:42 [DEBUG   ] Got command RPT from MCS: ref #5859
2018-08-17 11:37:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:37:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5859  77 58347 41862253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:37:42 [DEBUG   ] Got command RPT from MCS: ref #5860
2018-08-17 11:37:42 [DEBUG   ] summary = ERROR
2018-08-17 11:37:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5860  13 58347 41862457 A  ERRORERROR'
2018-08-17 11:37:42 [DEBUG   ] Got command RPT from MCS: ref #5861
2018-08-17 11:37:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:37:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5861  77 58347 41862661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:37:42 [DEBUG   ] Got command RPT from MCS: ref #5862
2018-08-17 11:37:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:37:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5862  12 58347 41862853 A  ERRORB“™š'
2018-08-17 11:37:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 11:38:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 11:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:38:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:38:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:38:26 [DEBUG   ] Finished updating board flags in 2.187 seconds
2018-08-17 11:38:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 11:38:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 11:39:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 11:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:39:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:39:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:39:26 [DEBUG   ] Finished updating board flags in 2.047 seconds
2018-08-17 11:39:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 11:39:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 11:40:03 [DEBUG   ] Got command RPT from MCS: ref #5867
2018-08-17 11:40:03 [DEBUG   ] summary = ERROR
2018-08-17 11:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5867  13 58347 42003697 A  ERRORERROR'
2018-08-17 11:40:03 [DEBUG   ] Got command RPT from MCS: ref #5868
2018-08-17 11:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5868  77 58347 42003698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:40:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 11:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:40:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:40:26 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-08-17 11:40:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 11:40:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 11:41:14 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-08-17 11:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:41:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:41:26 [DEBUG   ] Finished updating board flags in 1.898 seconds
2018-08-17 11:41:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 11:41:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 11:42:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:42:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:42:26 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-08-17 11:42:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:42:42 [DEBUG   ] Got command RPT from MCS: ref #5890
2018-08-17 11:42:42 [DEBUG   ] summary = ERROR
2018-08-17 11:42:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5890  13 58347 42162133 A  ERRORERROR'
2018-08-17 11:42:42 [DEBUG   ] Got command RPT from MCS: ref #5891
2018-08-17 11:42:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:42:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5891  77 58347 42162337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:42:42 [DEBUG   ] Got command RPT from MCS: ref #5892
2018-08-17 11:42:42 [DEBUG   ] summary = ERROR
2018-08-17 11:42:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5892  13 58347 42162556 A  ERRORERROR'
2018-08-17 11:42:42 [DEBUG   ] Got command RPT from MCS: ref #5893
2018-08-17 11:42:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:42:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5893  77 58347 42162745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:42:42 [DEBUG   ] Got command RPT from MCS: ref #5895
2018-08-17 11:42:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:42:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5895  12 58347 42162937 A  ERRORB“™š'
2018-08-17 11:42:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 11:43:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 11:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:43:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:43:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 11:43:26 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-08-17 11:43:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:43:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:44:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 11:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:44:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:44:26 [DEBUG   ] Finished updating board flags in 1.635 seconds
2018-08-17 11:44:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 11:44:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 11:45:03 [DEBUG   ] Got command RPT from MCS: ref #5904
2018-08-17 11:45:03 [DEBUG   ] summary = ERROR
2018-08-17 11:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5904  13 58347 42303697 A  ERRORERROR'
2018-08-17 11:45:03 [DEBUG   ] Got command RPT from MCS: ref #5905
2018-08-17 11:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5905  77 58347 42303698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:45:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:45:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:45:26 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-08-17 11:45:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-08-17 11:45:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:46:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 11:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:46:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:46:26 [DEBUG   ] Finished updating board flags in 1.549 seconds
2018-08-17 11:46:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 11:46:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 11:47:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-08-17 11:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:47:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:47:26 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-08-17 11:47:34 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-08-17 11:47:42 [DEBUG   ] Got command RPT from MCS: ref #5923
2018-08-17 11:47:42 [DEBUG   ] summary = ERROR
2018-08-17 11:47:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5923  13 58347 42462217 A  ERRORERROR'
2018-08-17 11:47:42 [DEBUG   ] Got command RPT from MCS: ref #5925
2018-08-17 11:47:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:47:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5925  77 58347 42462421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:47:42 [DEBUG   ] Got command RPT from MCS: ref #5927
2018-08-17 11:47:42 [DEBUG   ] summary = ERROR
2018-08-17 11:47:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5927  13 58347 42462625 A  ERRORERROR'
2018-08-17 11:47:42 [DEBUG   ] Got command RPT from MCS: ref #5928
2018-08-17 11:47:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:47:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5928  77 58347 42462821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:47:43 [DEBUG   ] Got command RPT from MCS: ref #5929
2018-08-17 11:47:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:47:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5929  12 58347 42463025 A  ERRORB“™š'
2018-08-17 11:47:55 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-08-17 11:48:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 11:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:48:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:48:26 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-08-17 11:48:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:48:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 11:49:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 11:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:49:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:49:26 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-08-17 11:49:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:49:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 11:50:03 [DEBUG   ] Got command RPT from MCS: ref #5930
2018-08-17 11:50:03 [DEBUG   ] summary = ERROR
2018-08-17 11:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5930  13 58347 42603693 A  ERRORERROR'
2018-08-17 11:50:03 [DEBUG   ] Got command RPT from MCS: ref #5931
2018-08-17 11:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5931  77 58347 42603694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:50:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 11:50:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:50:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:50:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:50:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:50:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:50:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:50:26 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-08-17 11:50:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 11:50:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 11:51:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 11:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:51:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:51:27 [DEBUG   ] Finished updating board flags in 2.201 seconds
2018-08-17 11:51:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 11:51:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 11:52:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-08-17 11:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:52:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:52:27 [DEBUG   ] Finished updating board flags in 2.228 seconds
2018-08-17 11:52:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 11:52:42 [DEBUG   ] Got command RPT from MCS: ref #5953
2018-08-17 11:52:42 [DEBUG   ] summary = ERROR
2018-08-17 11:52:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5953  13 58347 42762309 A  ERRORERROR'
2018-08-17 11:52:42 [DEBUG   ] Got command RPT from MCS: ref #5954
2018-08-17 11:52:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:52:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5954  77 58347 42762513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:52:42 [DEBUG   ] Got command RPT from MCS: ref #5955
2018-08-17 11:52:42 [DEBUG   ] summary = ERROR
2018-08-17 11:52:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5955  13 58347 42762705 A  ERRORERROR'
2018-08-17 11:52:42 [DEBUG   ] Got command RPT from MCS: ref #5956
2018-08-17 11:52:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:52:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5956  77 58347 42762913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:52:43 [DEBUG   ] Got command RPT from MCS: ref #5958
2018-08-17 11:52:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5958  12 58347 42763117 A  ERRORB“™š'
2018-08-17 11:52:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-08-17 11:53:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 11:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:53:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:53:27 [DEBUG   ] Finished updating board flags in 2.152 seconds
2018-08-17 11:53:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:53:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 11:54:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:54:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:54:27 [DEBUG   ] Finished updating board flags in 2.083 seconds
2018-08-17 11:54:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 11:54:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-08-17 11:55:03 [DEBUG   ] Got command RPT from MCS: ref #5967
2018-08-17 11:55:03 [DEBUG   ] summary = ERROR
2018-08-17 11:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5967  13 58347 42903701 A  ERRORERROR'
2018-08-17 11:55:03 [DEBUG   ] Got command RPT from MCS: ref #5968
2018-08-17 11:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5968  77 58347 42903702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:55:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 11:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:55:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:55:27 [DEBUG   ] Finished updating board flags in 1.930 seconds
2018-08-17 11:55:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 11:55:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 11:56:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 11:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:56:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:56:27 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-08-17 11:56:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 11:56:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 11:57:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 11:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:57:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:57:27 [DEBUG   ] Finished updating board flags in 1.764 seconds
2018-08-17 11:57:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 11:57:42 [DEBUG   ] Got command RPT from MCS: ref #5988
2018-08-17 11:57:42 [DEBUG   ] summary = ERROR
2018-08-17 11:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5988  13 58347 43062397 A  ERRORERROR'
2018-08-17 11:57:42 [DEBUG   ] Got command RPT from MCS: ref #5989
2018-08-17 11:57:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5989  77 58347 43062589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:57:42 [DEBUG   ] Got command RPT from MCS: ref #5990
2018-08-17 11:57:42 [DEBUG   ] summary = ERROR
2018-08-17 11:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5990  13 58347 43062793 A  ERRORERROR'
2018-08-17 11:57:42 [DEBUG   ] Got command RPT from MCS: ref #5991
2018-08-17 11:57:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 11:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5991  77 58347 43062989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 11:57:43 [DEBUG   ] Got command RPT from MCS: ref #5992
2018-08-17 11:57:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 11:57:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5992  12 58347 43063193 A  ERRORB“™š'
2018-08-17 11:57:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 11:58:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 11:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:58:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:58:27 [DEBUG   ] Finished updating board flags in 1.653 seconds
2018-08-17 11:58:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 11:58:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 11:59:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-08-17 11:59:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 11:59:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 11:59:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 11:59:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 11:59:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 11:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 11:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 11:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 11:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 11:59:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 11:59:27 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-08-17 11:59:35 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 11:59:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-08-17 12:00:03 [DEBUG   ] Got command RPT from MCS: ref #5997
2018-08-17 12:00:03 [DEBUG   ] summary = ERROR
2018-08-17 12:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5997  13 58347 43203697 A  ERRORERROR'
2018-08-17 12:00:03 [DEBUG   ] Got command RPT from MCS: ref #5998
2018-08-17 12:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5998  77 58347 43203698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:00:16 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-08-17 12:00:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:00:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:00:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:00:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:00:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:00:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:00:27 [DEBUG   ] Finished updating board flags in 1.547 seconds
2018-08-17 12:00:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-08-17 12:00:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:01:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 12:01:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:01:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:01:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:01:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:01:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:01:27 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-08-17 12:01:36 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-08-17 12:01:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 12:02:16 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-08-17 12:02:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:02:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:02:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:02:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:02:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:02:27 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-08-17 12:02:36 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-08-17 12:02:42 [DEBUG   ] Got command RPT from MCS: ref #6018
2018-08-17 12:02:42 [DEBUG   ] summary = ERROR
2018-08-17 12:02:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6018  13 58347 43362481 A  ERRORERROR'
2018-08-17 12:02:42 [DEBUG   ] Got command RPT from MCS: ref #6020
2018-08-17 12:02:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:02:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6020  77 58347 43362674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:02:42 [DEBUG   ] Got command RPT from MCS: ref #6022
2018-08-17 12:02:42 [DEBUG   ] summary = ERROR
2018-08-17 12:02:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6022  13 58347 43362877 A  ERRORERROR'
2018-08-17 12:02:43 [DEBUG   ] Got command RPT from MCS: ref #6023
2018-08-17 12:02:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6023  77 58347 43363081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:02:43 [DEBUG   ] Got command RPT from MCS: ref #6025
2018-08-17 12:02:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 12:02:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6025  12 58347 43363285 A  ERRORB“™š'
2018-08-17 12:02:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-08-17 12:03:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-08-17 12:03:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:03:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:03:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:03:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:03:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:03:27 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-08-17 12:03:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-08-17 12:03:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-08-17 12:04:17 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-08-17 12:04:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:04:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:04:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:04:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:04:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:04:27 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-08-17 12:04:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-08-17 12:04:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 12:05:03 [DEBUG   ] Got command RPT from MCS: ref #6030
2018-08-17 12:05:03 [DEBUG   ] summary = ERROR
2018-08-17 12:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6030  13 58347 43503701 A  ERRORERROR'
2018-08-17 12:05:03 [DEBUG   ] Got command RPT from MCS: ref #6031
2018-08-17 12:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6031  77 58347 43503702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:05:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 12:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:05:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:05:28 [DEBUG   ] Finished updating board flags in 2.152 seconds
2018-08-17 12:05:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:05:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:06:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 12:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:06:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:06:28 [DEBUG   ] Finished updating board flags in 2.067 seconds
2018-08-17 12:06:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 12:06:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:07:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:07:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:07:28 [DEBUG   ] Finished updating board flags in 1.937 seconds
2018-08-17 12:07:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 12:07:42 [DEBUG   ] Got command RPT from MCS: ref #6051
2018-08-17 12:07:42 [DEBUG   ] summary = ERROR
2018-08-17 12:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6051  13 58347 43662568 A  ERRORERROR'
2018-08-17 12:07:42 [DEBUG   ] Got command RPT from MCS: ref #6052
2018-08-17 12:07:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6052  77 58347 43662769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:07:42 [DEBUG   ] Got command RPT from MCS: ref #6053
2018-08-17 12:07:42 [DEBUG   ] summary = ERROR
2018-08-17 12:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6053  13 58347 43662961 A  ERRORERROR'
2018-08-17 12:07:43 [DEBUG   ] Got command RPT from MCS: ref #6054
2018-08-17 12:07:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6054  77 58347 43663165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:07:43 [DEBUG   ] Got command RPT from MCS: ref #6055
2018-08-17 12:07:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 12:07:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6055  12 58347 43663369 A  ERRORB“™š'
2018-08-17 12:07:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 12:08:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:08:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:08:28 [DEBUG   ] Finished updating board flags in 1.853 seconds
2018-08-17 12:08:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:08:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 12:09:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 12:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:09:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:09:28 [DEBUG   ] Finished updating board flags in 1.734 seconds
2018-08-17 12:09:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:09:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:10:03 [DEBUG   ] Got command RPT from MCS: ref #6060
2018-08-17 12:10:03 [DEBUG   ] summary = ERROR
2018-08-17 12:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6060  13 58347 43803693 A  ERRORERROR'
2018-08-17 12:10:03 [DEBUG   ] Got command RPT from MCS: ref #6061
2018-08-17 12:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6061  77 58347 43803694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:10:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 12:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:10:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:10:28 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-08-17 12:10:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 12:10:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:11:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:11:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:11:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:11:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:11:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:11:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:11:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:11:28 [DEBUG   ] Finished updating board flags in 1.663 seconds
2018-08-17 12:11:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 12:11:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 12:12:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:12:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:12:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:12:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:12:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:12:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:12:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:12:28 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-08-17 12:12:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-08-17 12:12:42 [DEBUG   ] Got command RPT from MCS: ref #6083
2018-08-17 12:12:42 [DEBUG   ] summary = ERROR
2018-08-17 12:12:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6083  13 58347 43962653 A  ERRORERROR'
2018-08-17 12:12:42 [DEBUG   ] Got command RPT from MCS: ref #6084
2018-08-17 12:12:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:12:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6084  77 58347 43962845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:12:43 [DEBUG   ] Got command RPT from MCS: ref #6085
2018-08-17 12:12:43 [DEBUG   ] summary = ERROR
2018-08-17 12:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6085  13 58347 43963049 A  ERRORERROR'
2018-08-17 12:12:43 [DEBUG   ] Got command RPT from MCS: ref #6086
2018-08-17 12:12:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6086  77 58347 43963253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:12:43 [DEBUG   ] Got command RPT from MCS: ref #6088
2018-08-17 12:12:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 12:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6088  12 58347 43963445 A  ERRORB“™š'
2018-08-17 12:12:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 12:13:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-08-17 12:13:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:13:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:13:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:13:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:13:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:13:28 [DEBUG   ] Finished updating board flags in 1.519 seconds
2018-08-17 12:13:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 12:13:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 12:14:17 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-08-17 12:14:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:14:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:14:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:14:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:14:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:14:28 [DEBUG   ] Finished updating board flags in 1.518 seconds
2018-08-17 12:14:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 12:14:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 12:15:03 [DEBUG   ] Got command RPT from MCS: ref #6097
2018-08-17 12:15:03 [DEBUG   ] summary = ERROR
2018-08-17 12:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6097  13 58347 44103701 A  ERRORERROR'
2018-08-17 12:15:03 [DEBUG   ] Got command RPT from MCS: ref #6098
2018-08-17 12:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6098  77 58347 44103702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:15:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 12:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:15:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:15:29 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-08-17 12:15:37 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-08-17 12:15:57 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 12:16:18 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-08-17 12:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:16:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:16:29 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-08-17 12:16:38 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-08-17 12:16:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-08-17 12:17:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-08-17 12:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:17:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:17:29 [DEBUG   ] Finished updating board flags in 2.143 seconds
2018-08-17 12:17:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 12:17:42 [DEBUG   ] Got command RPT from MCS: ref #6116
2018-08-17 12:17:42 [DEBUG   ] summary = ERROR
2018-08-17 12:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6116  13 58347 44262733 A  ERRORERROR'
2018-08-17 12:17:42 [DEBUG   ] Got command RPT from MCS: ref #6118
2018-08-17 12:17:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:17:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6118  77 58347 44262937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:17:43 [DEBUG   ] Got command RPT from MCS: ref #6120
2018-08-17 12:17:43 [DEBUG   ] summary = ERROR
2018-08-17 12:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6120  13 58347 44263129 A  ERRORERROR'
2018-08-17 12:17:43 [DEBUG   ] Got command RPT from MCS: ref #6121
2018-08-17 12:17:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6121  77 58347 44263333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:17:43 [DEBUG   ] Got command RPT from MCS: ref #6122
2018-08-17 12:17:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 12:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6122  12 58347 44263537 A  ERRORB“™š'
2018-08-17 12:17:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 12:18:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 12:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:18:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:18:29 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-08-17 12:18:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-08-17 12:18:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 12:19:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 12:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:19:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:19:29 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-08-17 12:19:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 12:19:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 12:20:03 [DEBUG   ] Got command RPT from MCS: ref #6123
2018-08-17 12:20:03 [DEBUG   ] summary = ERROR
2018-08-17 12:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6123  13 58347 44403705 A  ERRORERROR'
2018-08-17 12:20:03 [DEBUG   ] Got command RPT from MCS: ref #6124
2018-08-17 12:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6124  77 58347 44403706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:20:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 12:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:20:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:20:29 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-08-17 12:20:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-08-17 12:20:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-08-17 12:21:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-08-17 12:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:21:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:21:29 [DEBUG   ] Finished updating board flags in 1.914 seconds
2018-08-17 12:21:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-08-17 12:21:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 12:22:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 12:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:22:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:22:29 [DEBUG   ] Finished updating board flags in 1.693 seconds
2018-08-17 12:22:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 12:22:42 [DEBUG   ] Got command RPT from MCS: ref #6146
2018-08-17 12:22:42 [DEBUG   ] summary = ERROR
2018-08-17 12:22:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6146  13 58347 44562817 A  ERRORERROR'
2018-08-17 12:22:43 [DEBUG   ] Got command RPT from MCS: ref #6147
2018-08-17 12:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6147  77 58347 44563021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:22:43 [DEBUG   ] Got command RPT from MCS: ref #6148
2018-08-17 12:22:43 [DEBUG   ] summary = ERROR
2018-08-17 12:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6148  13 58347 44563213 A  ERRORERROR'
2018-08-17 12:22:43 [DEBUG   ] Got command RPT from MCS: ref #6149
2018-08-17 12:22:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-08-17 12:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6149  77 58347 44563417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-08-17 12:22:43 [DEBUG   ] Got command RPT from MCS: ref #6151
2018-08-17 12:22:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-08-17 12:22:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6151  12 58347 44563621 A  ERRORB“™š'
2018-08-17 12:22:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-08-17 12:23:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-08-17 12:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:23:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:23:29 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-08-17 12:23:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-08-17 12:23:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-08-17 12:24:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-08-17 12:24:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 2253
2018-08-17 12:24:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 2253
2018-08-17 12:24:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 2253
2018-08-17 12:24:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 2253
2018-08-17 12:24:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 2253
2018-08-17 12:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 2253
2018-08-17 12:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 2253
2018-08-17 12:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 2253
2018-08-17 12:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 2253
2018-08-17 12:24:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 2253
2018-08-17 12:24:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-08-17 12:24:29 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-08-17 12:24:38 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-08-17 12:24:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
