2018-10-21 12:25:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 12:25:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-21 12:25:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:25:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:25:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:25:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:25:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:25:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:25:43 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-10-21 12:25:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 12:26:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 12:26:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 12:26:34 [DEBUG   ] Got command RPT from MCS: ref #224611
2018-10-21 12:26:34 [DEBUG   ] summary = ERROR
2018-10-21 12:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224611  13 58412 44794041 A  ERRORERROR'
2018-10-21 12:26:34 [DEBUG   ] Got command RPT from MCS: ref #224612
2018-10-21 12:26:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224612  77 58412 44794245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:26:34 [DEBUG   ] Got command RPT from MCS: ref #224613
2018-10-21 12:26:34 [DEBUG   ] summary = ERROR
2018-10-21 12:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224613  13 58412 44794449 A  ERRORERROR'
2018-10-21 12:26:34 [DEBUG   ] Got command RPT from MCS: ref #224614
2018-10-21 12:26:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224614  77 58412 44794653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:26:34 [DEBUG   ] Got command RPT from MCS: ref #224615
2018-10-21 12:26:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 12:26:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224615  12 58412 44794845 A  ERRORB•™š'
2018-10-21 12:26:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:26:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:26:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:26:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:26:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:26:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:26:43 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-10-21 12:26:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 12:27:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 12:27:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 12:27:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:27:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 12:27:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:27:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:27:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:27:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:27:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:27:43 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-21 12:27:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 12:28:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 12:28:28 [DEBUG   ] Got command RPT from MCS: ref #224620
2018-10-21 12:28:28 [DEBUG   ] summary = ERROR
2018-10-21 12:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224620  13 58412 44908589 A  ERRORERROR'
2018-10-21 12:28:28 [DEBUG   ] Got command RPT from MCS: ref #224621
2018-10-21 12:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224621  77 58412 44908590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:28:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 12:28:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:28:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:28:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:28:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:28:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:28:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:28:43 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-21 12:28:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 12:29:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 12:29:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 12:29:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:29:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:29:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:29:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:29:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:29:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:29:43 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-10-21 12:29:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-21 12:30:13 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-21 12:30:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 12:30:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:30:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:30:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:30:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:30:43 [WARNING ] (13, 1, 'bot')
2018-10-21 12:30:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:30:43 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-10-21 12:30:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 12:31:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 12:31:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 12:31:34 [DEBUG   ] Got command RPT from MCS: ref #224643
2018-10-21 12:31:34 [DEBUG   ] summary = ERROR
2018-10-21 12:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224643  13 58412 45094133 A  ERRORERROR'
2018-10-21 12:31:34 [DEBUG   ] Got command RPT from MCS: ref #224644
2018-10-21 12:31:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224644  77 58412 45094325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:31:34 [DEBUG   ] Got command RPT from MCS: ref #224645
2018-10-21 12:31:34 [DEBUG   ] summary = ERROR
2018-10-21 12:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224645  13 58412 45094529 A  ERRORERROR'
2018-10-21 12:31:34 [DEBUG   ] Got command RPT from MCS: ref #224647
2018-10-21 12:31:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224647  77 58412 45094733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:31:34 [DEBUG   ] Got command RPT from MCS: ref #224648
2018-10-21 12:31:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 12:31:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224648  12 58412 45094937 A  ERRORB”™š'
2018-10-21 12:31:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:31:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 12:31:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:31:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:31:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:31:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:31:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:31:44 [DEBUG   ] Finished updating board flags in 2.047 seconds
2018-10-21 12:31:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 12:32:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 12:32:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 12:32:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:32:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:32:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:32:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:32:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:32:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:32:44 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-10-21 12:32:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 12:33:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 12:33:28 [DEBUG   ] Got command RPT from MCS: ref #224657
2018-10-21 12:33:28 [DEBUG   ] summary = ERROR
2018-10-21 12:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224657  13 58412 45208593 A  ERRORERROR'
2018-10-21 12:33:28 [DEBUG   ] Got command RPT from MCS: ref #224658
2018-10-21 12:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224658  77 58412 45208594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:33:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 12:33:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:33:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:33:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:33:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:33:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:33:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:33:44 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-21 12:33:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 12:34:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 12:34:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 12:34:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 12:34:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:34:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:34:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:34:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:34:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:34:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:34:44 [DEBUG   ] Finished updating board flags in 1.884 seconds
2018-10-21 12:34:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 12:35:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 12:35:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 12:35:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:35:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:35:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:35:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:35:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:35:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:35:44 [DEBUG   ] Finished updating board flags in 1.716 seconds
2018-10-21 12:35:54 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-21 12:36:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-21 12:36:34 [DEBUG   ] Got command RPT from MCS: ref #224678
2018-10-21 12:36:34 [DEBUG   ] summary = ERROR
2018-10-21 12:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224678  13 58412 45394205 A  ERRORERROR'
2018-10-21 12:36:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 12:36:34 [DEBUG   ] Got command RPT from MCS: ref #224679
2018-10-21 12:36:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224679  77 58412 45394409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:36:34 [DEBUG   ] Got command RPT from MCS: ref #224680
2018-10-21 12:36:34 [DEBUG   ] summary = ERROR
2018-10-21 12:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224680  13 58412 45394613 A  ERRORERROR'
2018-10-21 12:36:34 [DEBUG   ] Got command RPT from MCS: ref #224681
2018-10-21 12:36:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:36:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224681  77 58412 45394817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:36:35 [DEBUG   ] Got command RPT from MCS: ref #224682
2018-10-21 12:36:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 12:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224682  12 58412 45395009 A  ERRORB—™š'
2018-10-21 12:36:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:36:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:36:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:36:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:36:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:36:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:36:44 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-21 12:36:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 12:37:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 12:37:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 12:37:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:37:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:37:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:37:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:37:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:37:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:37:44 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-21 12:37:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 12:38:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 12:38:28 [DEBUG   ] Got command RPT from MCS: ref #224683
2018-10-21 12:38:28 [DEBUG   ] summary = ERROR
2018-10-21 12:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224683  13 58412 45508589 A  ERRORERROR'
2018-10-21 12:38:28 [DEBUG   ] Got command RPT from MCS: ref #224684
2018-10-21 12:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224684  77 58412 45508590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:38:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 12:38:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:38:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 12:38:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:38:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:38:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:38:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:38:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:38:44 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-21 12:38:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 12:39:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 12:39:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 12:39:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:39:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 12:39:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:39:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:39:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:39:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:39:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:39:44 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-21 12:39:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 12:40:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 12:40:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 12:40:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:40:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:40:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:40:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:40:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:40:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:40:44 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-21 12:40:55 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-21 12:41:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 12:41:34 [DEBUG   ] Got command RPT from MCS: ref #224706
2018-10-21 12:41:34 [DEBUG   ] summary = ERROR
2018-10-21 12:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224706  13 58412 45694285 A  ERRORERROR'
2018-10-21 12:41:34 [DEBUG   ] Got command RPT from MCS: ref #224707
2018-10-21 12:41:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224707  77 58412 45694489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:41:34 [DEBUG   ] Got command RPT from MCS: ref #224708
2018-10-21 12:41:34 [DEBUG   ] summary = ERROR
2018-10-21 12:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224708  13 58412 45694693 A  ERRORERROR'
2018-10-21 12:41:34 [DEBUG   ] Got command RPT from MCS: ref #224710
2018-10-21 12:41:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:41:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224710  77 58412 45694885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:41:35 [DEBUG   ] Got command RPT from MCS: ref #224711
2018-10-21 12:41:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 12:41:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224711  12 58412 45695089 A  ERRORB–™š'
2018-10-21 12:41:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 12:41:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:41:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 12:41:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:41:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:41:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:41:44 [WARNING ] (13, 1, 'bot')
2018-10-21 12:41:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:41:44 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-21 12:41:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 12:42:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 12:42:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 12:42:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:42:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:42:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:42:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:42:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:42:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:42:45 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-10-21 12:42:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 12:43:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 12:43:28 [DEBUG   ] Got command RPT from MCS: ref #224720
2018-10-21 12:43:28 [DEBUG   ] summary = ERROR
2018-10-21 12:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224720  13 58412 45808597 A  ERRORERROR'
2018-10-21 12:43:28 [DEBUG   ] Got command RPT from MCS: ref #224721
2018-10-21 12:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224721  77 58412 45808598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:43:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 12:43:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:43:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:43:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:43:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:43:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:43:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:43:45 [DEBUG   ] Finished updating board flags in 2.176 seconds
2018-10-21 12:43:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 12:44:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 12:44:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 12:44:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:44:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:44:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:44:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:44:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:44:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:44:45 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-10-21 12:44:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 12:45:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 12:45:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 12:45:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:45:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:45:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:45:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:45:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:45:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:45:45 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-21 12:45:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 12:46:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 12:46:34 [DEBUG   ] Got command RPT from MCS: ref #224741
2018-10-21 12:46:34 [DEBUG   ] summary = ERROR
2018-10-21 12:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224741  13 58412 45994365 A  ERRORERROR'
2018-10-21 12:46:34 [DEBUG   ] Got command RPT from MCS: ref #224742
2018-10-21 12:46:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224742  77 58412 45994569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:46:34 [DEBUG   ] Got command RPT from MCS: ref #224743
2018-10-21 12:46:34 [DEBUG   ] summary = ERROR
2018-10-21 12:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224743  13 58412 45994773 A  ERRORERROR'
2018-10-21 12:46:34 [DEBUG   ] Got command RPT from MCS: ref #224744
2018-10-21 12:46:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:46:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224744  77 58412 45994966 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:46:35 [DEBUG   ] Got command RPT from MCS: ref #224745
2018-10-21 12:46:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 12:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224745  12 58412 45995169 A  ERRORB•™š'
2018-10-21 12:46:36 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-21 12:46:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:46:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 12:46:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:46:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:46:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:46:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:46:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:46:45 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-10-21 12:46:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 12:47:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 12:47:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 12:47:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:47:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:47:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:47:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:47:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:47:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:47:45 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-21 12:47:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 12:48:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 12:48:28 [DEBUG   ] Got command RPT from MCS: ref #224750
2018-10-21 12:48:28 [DEBUG   ] summary = ERROR
2018-10-21 12:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224750  13 58412 46108597 A  ERRORERROR'
2018-10-21 12:48:28 [DEBUG   ] Got command RPT from MCS: ref #224751
2018-10-21 12:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224751  77 58412 46108598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:48:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 12:48:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:48:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:48:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:48:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:48:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:48:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:48:45 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-10-21 12:48:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 12:49:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 12:49:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 12:49:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:49:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:49:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:49:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:49:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:49:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:49:45 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-21 12:49:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 12:50:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 12:50:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 12:50:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:50:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:50:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:50:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:50:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:50:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:50:45 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-21 12:50:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 12:51:17 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-21 12:51:34 [DEBUG   ] Got command RPT from MCS: ref #224773
2018-10-21 12:51:34 [DEBUG   ] summary = ERROR
2018-10-21 12:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224773  13 58412 46294445 A  ERRORERROR'
2018-10-21 12:51:34 [DEBUG   ] Got command RPT from MCS: ref #224774
2018-10-21 12:51:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224774  77 58412 46294649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:51:34 [DEBUG   ] Got command RPT from MCS: ref #224775
2018-10-21 12:51:34 [DEBUG   ] summary = ERROR
2018-10-21 12:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224775  13 58412 46294853 A  ERRORERROR'
2018-10-21 12:51:35 [DEBUG   ] Got command RPT from MCS: ref #224777
2018-10-21 12:51:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224777  77 58412 46295057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:51:35 [DEBUG   ] Got command RPT from MCS: ref #224778
2018-10-21 12:51:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 12:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224778  12 58412 46295249 A  ERRORB•™š'
2018-10-21 12:51:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 12:51:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:51:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:51:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:51:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:51:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:51:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:51:45 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-21 12:51:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 12:52:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 12:52:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 12:52:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:52:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:52:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:52:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:52:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:52:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:52:45 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-21 12:52:57 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-10-21 12:53:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 12:53:28 [DEBUG   ] Got command RPT from MCS: ref #224783
2018-10-21 12:53:28 [DEBUG   ] summary = ERROR
2018-10-21 12:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224783  13 58412 46408597 A  ERRORERROR'
2018-10-21 12:53:28 [DEBUG   ] Got command RPT from MCS: ref #224784
2018-10-21 12:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224784  77 58412 46408598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:53:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 12:53:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:53:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:53:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:53:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:53:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:53:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:53:45 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-21 12:53:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 12:54:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 12:54:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 12:54:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:54:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:54:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:54:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:54:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:54:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:54:45 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-10-21 12:54:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 12:55:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 12:55:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 12:55:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:55:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:55:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:55:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:55:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:55:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:55:45 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-10-21 12:55:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 12:56:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 12:56:34 [DEBUG   ] Got command RPT from MCS: ref #224804
2018-10-21 12:56:34 [DEBUG   ] summary = ERROR
2018-10-21 12:56:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224804  13 58412 46594533 A  ERRORERROR'
2018-10-21 12:56:34 [DEBUG   ] Got command RPT from MCS: ref #224805
2018-10-21 12:56:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:56:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224805  77 58412 46594725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:56:34 [DEBUG   ] Got command RPT from MCS: ref #224806
2018-10-21 12:56:34 [DEBUG   ] summary = ERROR
2018-10-21 12:56:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224806  13 58412 46594929 A  ERRORERROR'
2018-10-21 12:56:35 [DEBUG   ] Got command RPT from MCS: ref #224807
2018-10-21 12:56:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224807  77 58412 46595133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:56:35 [DEBUG   ] Got command RPT from MCS: ref #224808
2018-10-21 12:56:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 12:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224808  12 58412 46595337 A  ERRORB—™š'
2018-10-21 12:56:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 12:56:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:56:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:56:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:56:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:56:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:56:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:56:45 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-10-21 12:56:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 12:57:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-21 12:57:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 12:57:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:57:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:57:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:57:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:57:45 [WARNING ] (13, 1, 'bot')
2018-10-21 12:57:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:57:45 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-21 12:57:58 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-21 12:58:18 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-10-21 12:58:28 [DEBUG   ] Got command RPT from MCS: ref #224813
2018-10-21 12:58:28 [DEBUG   ] summary = ERROR
2018-10-21 12:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224813  13 58412 46708593 A  ERRORERROR'
2018-10-21 12:58:28 [DEBUG   ] Got command RPT from MCS: ref #224814
2018-10-21 12:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 12:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224814  77 58412 46708594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 12:58:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 12:58:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:58:46 [WARNING ] (13, 1, 'bot')
2018-10-21 12:58:46 [WARNING ] (13, 1, 'bot')
2018-10-21 12:58:46 [WARNING ] (13, 1, 'bot')
2018-10-21 12:58:46 [WARNING ] (13, 1, 'bot')
2018-10-21 12:58:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:58:46 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-10-21 12:58:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 12:59:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 12:59:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 12:59:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 12:59:46 [WARNING ] (13, 1, 'bot')
2018-10-21 12:59:46 [WARNING ] (13, 1, 'bot')
2018-10-21 12:59:46 [WARNING ] (13, 1, 'bot')
2018-10-21 12:59:46 [WARNING ] (13, 1, 'bot')
2018-10-21 12:59:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 12:59:46 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-21 12:59:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-21 13:00:18 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-21 13:00:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 13:00:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:00:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:00:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:00:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:00:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:00:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:00:46 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-21 13:00:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:01:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 13:01:34 [DEBUG   ] Got command RPT from MCS: ref #224836
2018-10-21 13:01:34 [DEBUG   ] summary = ERROR
2018-10-21 13:01:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224836  13 58412 46894605 A  ERRORERROR'
2018-10-21 13:01:34 [DEBUG   ] Got command RPT from MCS: ref #224837
2018-10-21 13:01:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:01:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224837  77 58412 46894809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:01:35 [DEBUG   ] Got command RPT from MCS: ref #224838
2018-10-21 13:01:35 [DEBUG   ] summary = ERROR
2018-10-21 13:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224838  13 58412 46895013 A  ERRORERROR'
2018-10-21 13:01:35 [DEBUG   ] Got command RPT from MCS: ref #224840
2018-10-21 13:01:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224840  77 58412 46895205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:01:35 [DEBUG   ] Got command RPT from MCS: ref #224841
2018-10-21 13:01:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224841  12 58412 46895409 A  ERRORB–™š'
2018-10-21 13:01:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 13:01:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:01:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:01:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:01:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:01:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:01:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:01:46 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-10-21 13:01:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 13:02:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 13:02:38 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-21 13:02:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:02:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:02:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:02:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:02:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:02:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:02:46 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-21 13:02:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 13:03:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 13:03:28 [DEBUG   ] Got command RPT from MCS: ref #224850
2018-10-21 13:03:28 [DEBUG   ] summary = ERROR
2018-10-21 13:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224850  13 58412 47008597 A  ERRORERROR'
2018-10-21 13:03:28 [DEBUG   ] Got command RPT from MCS: ref #224851
2018-10-21 13:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224851  77 58412 47008598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:03:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-21 13:03:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:03:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:03:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:03:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:03:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:03:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:03:46 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-21 13:03:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 13:04:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 13:04:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 13:04:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:04:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:04:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:04:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:04:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:04:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:04:46 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-10-21 13:04:59 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-10-21 13:05:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 13:05:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 13:05:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:05:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:05:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:05:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:05:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:05:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:05:46 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-21 13:05:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 13:06:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 13:06:34 [DEBUG   ] Got command RPT from MCS: ref #224871
2018-10-21 13:06:34 [DEBUG   ] summary = ERROR
2018-10-21 13:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224871  13 58412 47194685 A  ERRORERROR'
2018-10-21 13:06:34 [DEBUG   ] Got command RPT from MCS: ref #224872
2018-10-21 13:06:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224872  77 58412 47194889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:06:35 [DEBUG   ] Got command RPT from MCS: ref #224873
2018-10-21 13:06:35 [DEBUG   ] summary = ERROR
2018-10-21 13:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224873  13 58412 47195093 A  ERRORERROR'
2018-10-21 13:06:35 [DEBUG   ] Got command RPT from MCS: ref #224874
2018-10-21 13:06:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224874  77 58412 47195285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:06:35 [DEBUG   ] Got command RPT from MCS: ref #224875
2018-10-21 13:06:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224875  12 58412 47195489 A  ERRORB•™š'
2018-10-21 13:06:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 13:06:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:06:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:06:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:06:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:06:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:06:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:06:46 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-21 13:06:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 13:07:20 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-21 13:07:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-21 13:07:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:07:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:07:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:07:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:07:46 [WARNING ] (13, 1, 'bot')
2018-10-21 13:07:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:07:46 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-10-21 13:08:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:08:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 13:08:28 [DEBUG   ] Got command RPT from MCS: ref #224876
2018-10-21 13:08:28 [DEBUG   ] summary = ERROR
2018-10-21 13:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224876  13 58412 47308601 A  ERRORERROR'
2018-10-21 13:08:28 [DEBUG   ] Got command RPT from MCS: ref #224877
2018-10-21 13:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224877  77 58412 47308602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:08:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 13:08:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:08:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:08:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:08:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:08:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:08:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:08:47 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-10-21 13:09:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 13:09:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 13:09:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 13:09:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:09:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:09:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:09:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:09:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:09:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:09:47 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-21 13:10:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 13:10:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 13:10:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:10:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-21 13:10:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:10:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:10:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:10:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:10:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:10:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:10:47 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-21 13:11:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:11:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 13:11:34 [DEBUG   ] Got command RPT from MCS: ref #224899
2018-10-21 13:11:34 [DEBUG   ] summary = ERROR
2018-10-21 13:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224899  13 58412 47494765 A  ERRORERROR'
2018-10-21 13:11:34 [DEBUG   ] Got command RPT from MCS: ref #224900
2018-10-21 13:11:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:11:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224900  77 58412 47494969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:11:35 [DEBUG   ] Got command RPT from MCS: ref #224901
2018-10-21 13:11:35 [DEBUG   ] summary = ERROR
2018-10-21 13:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224901  13 58412 47495173 A  ERRORERROR'
2018-10-21 13:11:35 [DEBUG   ] Got command RPT from MCS: ref #224903
2018-10-21 13:11:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224903  77 58412 47495365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:11:35 [DEBUG   ] Got command RPT from MCS: ref #224905
2018-10-21 13:11:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224905  12 58412 47495569 A  ERRORB•™š'
2018-10-21 13:11:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 13:11:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:11:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:11:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:11:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:11:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:11:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:11:47 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-21 13:12:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:12:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 13:12:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-21 13:12:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:12:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:12:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:12:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:12:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:12:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:12:47 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-10-21 13:13:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 13:13:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 13:13:28 [DEBUG   ] Got command RPT from MCS: ref #224913
2018-10-21 13:13:28 [DEBUG   ] summary = ERROR
2018-10-21 13:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224913  13 58412 47608605 A  ERRORERROR'
2018-10-21 13:13:28 [DEBUG   ] Got command RPT from MCS: ref #224914
2018-10-21 13:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224914  77 58412 47608606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:13:41 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2018-10-21 13:13:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:13:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:13:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:13:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:13:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:13:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:13:47 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-10-21 13:14:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 13:14:21 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2018-10-21 13:14:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 13:14:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:14:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:14:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:14:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:14:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:14:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:14:47 [DEBUG   ] Finished updating board flags in 1.529 seconds
2018-10-21 13:15:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-21 13:15:20 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 13:15:41 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 13:15:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:15:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:15:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:15:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:15:47 [WARNING ] (13, 1, 'bot')
2018-10-21 13:15:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:15:47 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-10-21 13:16:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-21 13:16:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 13:16:34 [DEBUG   ] Got command RPT from MCS: ref #224934
2018-10-21 13:16:34 [DEBUG   ] summary = ERROR
2018-10-21 13:16:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224934  13 58412 47794849 A  ERRORERROR'
2018-10-21 13:16:35 [DEBUG   ] Got command RPT from MCS: ref #224935
2018-10-21 13:16:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224935  77 58412 47795053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:16:35 [DEBUG   ] Got command RPT from MCS: ref #224936
2018-10-21 13:16:35 [DEBUG   ] summary = ERROR
2018-10-21 13:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224936  13 58412 47795257 A  ERRORERROR'
2018-10-21 13:16:35 [DEBUG   ] Got command RPT from MCS: ref #224937
2018-10-21 13:16:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224937  77 58412 47795449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:16:35 [DEBUG   ] Got command RPT from MCS: ref #224938
2018-10-21 13:16:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224938  12 58412 47795653 A  ERRORB–™š'
2018-10-21 13:16:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 13:16:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:16:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 13:16:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:16:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:16:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:16:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:16:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:16:48 [DEBUG   ] Finished updating board flags in 2.255 seconds
2018-10-21 13:17:01 [DEBUG   ] Finished updating ant stats in 0.874 seconds
2018-10-21 13:17:21 [DEBUG   ] Finished updating ant stats in 0.731 seconds
2018-10-21 13:17:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 13:17:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:17:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:17:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:17:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:17:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:17:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:17:48 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-10-21 13:18:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 13:18:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 13:18:28 [DEBUG   ] Got command RPT from MCS: ref #224943
2018-10-21 13:18:28 [DEBUG   ] summary = ERROR
2018-10-21 13:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224943  13 58412 47908605 A  ERRORERROR'
2018-10-21 13:18:28 [DEBUG   ] Got command RPT from MCS: ref #224944
2018-10-21 13:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224944  77 58412 47908606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:18:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 13:18:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:18:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:18:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:18:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:18:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:18:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:18:48 [DEBUG   ] Finished updating board flags in 2.085 seconds
2018-10-21 13:19:02 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 13:19:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 13:19:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 13:19:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:19:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:19:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:19:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:19:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:19:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:19:48 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-10-21 13:20:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 13:20:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:20:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:20:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:20:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:20:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:20:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:20:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:20:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:20:48 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-10-21 13:21:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 13:21:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 13:21:34 [DEBUG   ] Got command RPT from MCS: ref #224966
2018-10-21 13:21:34 [DEBUG   ] summary = ERROR
2018-10-21 13:21:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224966  13 58412 48094929 A  ERRORERROR'
2018-10-21 13:21:35 [DEBUG   ] Got command RPT from MCS: ref #224967
2018-10-21 13:21:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224967  77 58412 48095133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:21:35 [DEBUG   ] Got command RPT from MCS: ref #224968
2018-10-21 13:21:35 [DEBUG   ] summary = ERROR
2018-10-21 13:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224968  13 58412 48095337 A  ERRORERROR'
2018-10-21 13:21:35 [DEBUG   ] Got command RPT from MCS: ref #224970
2018-10-21 13:21:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224970  77 58412 48095529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:21:35 [DEBUG   ] Got command RPT from MCS: ref #224972
2018-10-21 13:21:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224972  12 58412 48095733 A  ERRORB•™š'
2018-10-21 13:21:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 13:21:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:21:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 13:21:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:21:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:21:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:21:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:21:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:21:48 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-21 13:22:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 13:22:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 13:22:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 13:22:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:22:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:22:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:22:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:22:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:22:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:22:48 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-10-21 13:23:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:23:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:23:28 [DEBUG   ] Got command RPT from MCS: ref #224976
2018-10-21 13:23:28 [DEBUG   ] summary = ERROR
2018-10-21 13:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224976  13 58412 48208605 A  ERRORERROR'
2018-10-21 13:23:28 [DEBUG   ] Got command RPT from MCS: ref #224977
2018-10-21 13:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224977  77 58412 48208606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:23:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 13:23:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:23:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:23:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:23:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:23:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:23:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:23:48 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-21 13:24:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 13:24:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:24:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 13:24:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:24:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:24:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:24:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:24:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:24:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:24:48 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-21 13:25:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 13:25:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 13:25:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:25:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:25:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:25:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:25:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:25:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:25:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:25:48 [DEBUG   ] Finished updating board flags in 1.692 seconds
2018-10-21 13:26:00 [DEBUG   ] Got command TBN from MCS: ref #224997
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-21 13:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   224997   8 58412 48360477 A  ERROR'
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540128361']
2018-10-21 13:26:00 [DEBUG   ] spawn_process: at 2018-10-21 13:26:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540128361']
2018-10-21 13:26:00 [INFO    ] Finished spawning TBN in 0.053 s
2018-10-21 13:26:02 [DEBUG   ] Finished updating ant stats in 0.733 seconds
2018-10-21 13:26:22 [DEBUG   ] Finished updating ant stats in 0.666 seconds
2018-10-21 13:26:35 [DEBUG   ] Got command RPT from MCS: ref #224998
2018-10-21 13:26:35 [DEBUG   ] summary = ERROR
2018-10-21 13:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224998  13 58412 48395013 A  ERRORERROR'
2018-10-21 13:26:35 [DEBUG   ] Got command RPT from MCS: ref #224999
2018-10-21 13:26:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   224999  77 58412 48395205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:26:35 [DEBUG   ] Got command RPT from MCS: ref #225000
2018-10-21 13:26:35 [DEBUG   ] summary = ERROR
2018-10-21 13:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225000  13 58412 48395409 A  ERRORERROR'
2018-10-21 13:26:35 [DEBUG   ] Got command RPT from MCS: ref #225001
2018-10-21 13:26:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225001  77 58412 48395613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:26:35 [DEBUG   ] Got command RPT from MCS: ref #225002
2018-10-21 13:26:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225002  12 58412 48395817 A  ERRORB”™š'
2018-10-21 13:26:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 13:26:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:26:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:26:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:26:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:26:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:26:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:26:48 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-10-21 13:27:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 13:27:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 13:27:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 13:27:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:27:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:27:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:27:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:27:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:27:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:27:48 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-10-21 13:28:03 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 13:28:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 13:28:28 [DEBUG   ] Got command RPT from MCS: ref #225007
2018-10-21 13:28:28 [DEBUG   ] summary = ERROR
2018-10-21 13:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225007  13 58412 48508601 A  ERRORERROR'
2018-10-21 13:28:28 [DEBUG   ] Got command RPT from MCS: ref #225008
2018-10-21 13:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225008  77 58412 48508602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:28:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:28:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:28:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:28:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:28:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:28:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:28:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:28:48 [DEBUG   ] Finished updating board flags in 1.462 seconds
2018-10-21 13:29:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:29:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 13:29:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:29:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-21 13:29:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:29:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 13:29:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:29:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:29:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:29:48 [WARNING ] (13, 1, 'bot')
2018-10-21 13:29:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:29:48 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-10-21 13:30:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:30:11 [DEBUG   ] Got command TBW from MCS: ref #225029
2018-10-21 13:30:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-21 13:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   225029   8 58412 48611549 A  ERROR'
2018-10-21 13:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-21 13:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-21 13:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-21 13:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-21 13:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-21 13:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-21 13:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-21 13:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-21 13:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-21 13:30:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-21 13:30:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-21 13:30:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-21 13:30:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-21 13:30:15 [DEBUG   ] spawn_process: at 2018-10-21 13:30:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-21 13:30:15 [INFO    ] Finished spawning TBW
2018-10-21 13:30:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:30:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 13:30:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:30:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:30:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:30:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:30:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:30:49 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-10-21 13:31:35 [DEBUG   ] Got command RPT from MCS: ref #225035
2018-10-21 13:31:35 [DEBUG   ] summary = ERROR
2018-10-21 13:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225035  13 58412 48695093 A  ERRORERROR'
2018-10-21 13:31:35 [DEBUG   ] Got command RPT from MCS: ref #225036
2018-10-21 13:31:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225036  77 58412 48695297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:31:35 [DEBUG   ] Got command RPT from MCS: ref #225037
2018-10-21 13:31:35 [DEBUG   ] summary = ERROR
2018-10-21 13:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225037  13 58412 48695489 A  ERRORERROR'
2018-10-21 13:31:35 [DEBUG   ] Got command RPT from MCS: ref #225039
2018-10-21 13:31:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225039  77 58412 48695693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:31:35 [DEBUG   ] Got command RPT from MCS: ref #225041
2018-10-21 13:31:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:31:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225041  12 58412 48695897 A  ERRORB–™š'
2018-10-21 13:31:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:31:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:31:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:31:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:31:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:31:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:31:49 [DEBUG   ] Finished updating board flags in 2.080 seconds
2018-10-21 13:32:03 [INFO    ] __waitForTBW - TBW finished in 108.685 s
2018-10-21 13:32:04 [DEBUG   ] Finished updating ant stats in 0.421 seconds
2018-10-21 13:32:04 [INFO    ] Started antennas statistics background thread
2018-10-21 13:32:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540128726']
2018-10-21 13:32:04 [DEBUG   ] spawn_process: at 2018-10-21 13:32:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540128726']
2018-10-21 13:32:04 [INFO    ] Finished spawning TBN in 0.049 s
2018-10-21 13:32:24 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2018-10-21 13:32:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 13:32:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 13:32:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:32:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:32:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:32:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:32:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:32:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:32:49 [DEBUG   ] Finished updating board flags in 2.178 seconds
2018-10-21 13:33:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 13:33:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 13:33:28 [DEBUG   ] Got command RPT from MCS: ref #225053
2018-10-21 13:33:28 [DEBUG   ] summary = ERROR
2018-10-21 13:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225053  13 58412 48808605 A  ERRORERROR'
2018-10-21 13:33:28 [DEBUG   ] Got command RPT from MCS: ref #225054
2018-10-21 13:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225054  77 58412 48808606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:33:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 13:33:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:33:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:33:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:33:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:33:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:33:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:33:49 [DEBUG   ] Finished updating board flags in 1.869 seconds
2018-10-21 13:34:05 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-21 13:34:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 13:34:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:34:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:34:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:34:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:34:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:34:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:34:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:34:49 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-21 13:35:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 13:35:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 13:35:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 13:35:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:35:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:35:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:35:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:35:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:35:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:35:49 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-10-21 13:36:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 13:36:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:36:35 [DEBUG   ] Got command RPT from MCS: ref #225074
2018-10-21 13:36:35 [DEBUG   ] summary = ERROR
2018-10-21 13:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225074  13 58412 48995169 A  ERRORERROR'
2018-10-21 13:36:35 [DEBUG   ] Got command RPT from MCS: ref #225075
2018-10-21 13:36:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225075  77 58412 48995373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:36:35 [DEBUG   ] Got command RPT from MCS: ref #225076
2018-10-21 13:36:35 [DEBUG   ] summary = ERROR
2018-10-21 13:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225076  13 58412 48995577 A  ERRORERROR'
2018-10-21 13:36:35 [DEBUG   ] Got command RPT from MCS: ref #225077
2018-10-21 13:36:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225077  77 58412 48995769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:36:35 [DEBUG   ] Got command RPT from MCS: ref #225078
2018-10-21 13:36:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:36:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225078  12 58412 48995973 A  ERRORB–™š'
2018-10-21 13:36:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 13:36:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:36:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:36:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:36:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:36:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:36:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:36:49 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-21 13:37:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 13:37:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 13:37:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 13:37:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:37:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:37:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:37:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:37:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:37:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:37:49 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-10-21 13:38:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 13:38:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 13:38:28 [DEBUG   ] Got command RPT from MCS: ref #225079
2018-10-21 13:38:28 [DEBUG   ] summary = ERROR
2018-10-21 13:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225079  13 58412 49108609 A  ERRORERROR'
2018-10-21 13:38:28 [DEBUG   ] Got command RPT from MCS: ref #225080
2018-10-21 13:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225080  77 58412 49108610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:38:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:38:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:38:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 13:38:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:38:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:38:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:38:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:38:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:38:49 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-10-21 13:39:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:39:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 13:39:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 13:39:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:39:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:39:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:39:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:39:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:39:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:39:49 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-10-21 13:40:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:40:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:40:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 13:40:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:40:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:40:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:40:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:40:49 [WARNING ] (13, 1, 'bot')
2018-10-21 13:40:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:40:49 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-10-21 13:41:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 13:41:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:41:35 [DEBUG   ] Got command RPT from MCS: ref #225102
2018-10-21 13:41:35 [DEBUG   ] summary = ERROR
2018-10-21 13:41:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225102  13 58412 49295249 A  ERRORERROR'
2018-10-21 13:41:35 [DEBUG   ] Got command RPT from MCS: ref #225103
2018-10-21 13:41:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:41:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225103  77 58412 49295453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:41:35 [DEBUG   ] Got command RPT from MCS: ref #225104
2018-10-21 13:41:35 [DEBUG   ] summary = ERROR
2018-10-21 13:41:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225104  13 58412 49295657 A  ERRORERROR'
2018-10-21 13:41:35 [DEBUG   ] Got command RPT from MCS: ref #225106
2018-10-21 13:41:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:41:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225106  77 58412 49295849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:41:36 [DEBUG   ] Got command RPT from MCS: ref #225107
2018-10-21 13:41:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225107  12 58412 49296053 A  ERRORB•™š'
2018-10-21 13:41:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:41:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:41:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:41:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:41:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:41:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:41:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:41:50 [DEBUG   ] Finished updating board flags in 2.303 seconds
2018-10-21 13:42:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 13:42:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 13:42:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:42:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:42:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:42:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:42:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:42:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:42:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:42:50 [DEBUG   ] Finished updating board flags in 2.086 seconds
2018-10-21 13:43:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:43:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 13:43:28 [DEBUG   ] Got command RPT from MCS: ref #225116
2018-10-21 13:43:28 [DEBUG   ] summary = ERROR
2018-10-21 13:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225116  13 58412 49408605 A  ERRORERROR'
2018-10-21 13:43:28 [DEBUG   ] Got command RPT from MCS: ref #225117
2018-10-21 13:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225117  77 58412 49408606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:43:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 13:43:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:43:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:43:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:43:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:43:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:43:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:43:50 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-21 13:44:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 13:44:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 13:44:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 13:44:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:44:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:44:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:44:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:44:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:44:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:44:50 [DEBUG   ] Finished updating board flags in 1.997 seconds
2018-10-21 13:45:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 13:45:26 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-21 13:45:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-21 13:45:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:45:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:45:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:45:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:45:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:45:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:45:50 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-10-21 13:46:06 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-21 13:46:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 13:46:35 [DEBUG   ] Got command RPT from MCS: ref #225145
2018-10-21 13:46:35 [DEBUG   ] summary = ERROR
2018-10-21 13:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225145  13 58412 49595337 A  ERRORERROR'
2018-10-21 13:46:35 [DEBUG   ] Got command RPT from MCS: ref #225146
2018-10-21 13:46:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225146  77 58412 49595529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:46:35 [DEBUG   ] Got command RPT from MCS: ref #225147
2018-10-21 13:46:35 [DEBUG   ] summary = ERROR
2018-10-21 13:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225147  13 58412 49595733 A  ERRORERROR'
2018-10-21 13:46:35 [DEBUG   ] Got command RPT from MCS: ref #225148
2018-10-21 13:46:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225148  77 58412 49595937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:46:36 [DEBUG   ] Got command RPT from MCS: ref #225149
2018-10-21 13:46:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225149  12 58412 49596141 A  ERRORB”™š'
2018-10-21 13:46:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 13:46:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:46:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:46:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:46:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:46:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:46:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:46:50 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-21 13:47:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 13:47:26 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-21 13:47:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 13:47:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:47:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:47:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:47:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:47:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:47:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:47:50 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-10-21 13:48:06 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-21 13:48:27 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 13:48:28 [DEBUG   ] Got command RPT from MCS: ref #225159
2018-10-21 13:48:28 [DEBUG   ] summary = ERROR
2018-10-21 13:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225159  13 58412 49708605 A  ERRORERROR'
2018-10-21 13:48:28 [DEBUG   ] Got command RPT from MCS: ref #225160
2018-10-21 13:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225160  77 58412 49708606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:48:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 13:48:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:48:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:48:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:48:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:48:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:48:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:48:50 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-21 13:49:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 13:49:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 13:49:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:49:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:49:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:49:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:49:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:49:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:49:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:49:50 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-21 13:50:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:50:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 13:50:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 13:50:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:50:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 13:50:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:50:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:50:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:50:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:50:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:50:50 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-21 13:51:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 13:51:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 13:51:35 [DEBUG   ] Got command RPT from MCS: ref #225182
2018-10-21 13:51:35 [DEBUG   ] summary = ERROR
2018-10-21 13:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225182  13 58412 49895409 A  ERRORERROR'
2018-10-21 13:51:35 [DEBUG   ] Got command RPT from MCS: ref #225183
2018-10-21 13:51:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225183  77 58412 49895613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:51:35 [DEBUG   ] Got command RPT from MCS: ref #225184
2018-10-21 13:51:35 [DEBUG   ] summary = ERROR
2018-10-21 13:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225184  13 58412 49895817 A  ERRORERROR'
2018-10-21 13:51:36 [DEBUG   ] Got command RPT from MCS: ref #225186
2018-10-21 13:51:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225186  77 58412 49896021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:51:36 [DEBUG   ] Got command RPT from MCS: ref #225187
2018-10-21 13:51:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225187  12 58412 49896213 A  ERRORB–™š'
2018-10-21 13:51:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 13:51:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:51:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:51:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:51:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:51:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:51:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:51:50 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-10-21 13:52:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 13:52:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 13:52:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 13:52:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:52:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:52:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:52:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:52:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:52:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:52:50 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-10-21 13:53:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 13:53:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:53:28 [DEBUG   ] Got command RPT from MCS: ref #225192
2018-10-21 13:53:28 [DEBUG   ] summary = ERROR
2018-10-21 13:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225192  13 58412 50008605 A  ERRORERROR'
2018-10-21 13:53:28 [DEBUG   ] Got command RPT from MCS: ref #225193
2018-10-21 13:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225193  77 58412 50008606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:53:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:53:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:53:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:53:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:53:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:53:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:53:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:53:50 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-10-21 13:54:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 13:54:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 13:54:47 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 13:54:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:54:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:54:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:54:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:54:50 [WARNING ] (13, 1, 'bot')
2018-10-21 13:54:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:54:50 [DEBUG   ] Finished updating board flags in 1.511 seconds
2018-10-21 13:55:07 [DEBUG   ] Finished updating ant stats in 0.586 seconds
2018-10-21 13:55:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 13:55:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 13:55:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:55:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 13:55:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:55:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:55:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:55:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:55:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:55:51 [DEBUG   ] Finished updating board flags in 2.242 seconds
2018-10-21 13:56:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 13:56:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:56:35 [DEBUG   ] Got command RPT from MCS: ref #225213
2018-10-21 13:56:35 [DEBUG   ] summary = ERROR
2018-10-21 13:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225213  13 58412 50195489 A  ERRORERROR'
2018-10-21 13:56:35 [DEBUG   ] Got command RPT from MCS: ref #225214
2018-10-21 13:56:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225214  77 58412 50195693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:56:35 [DEBUG   ] Got command RPT from MCS: ref #225215
2018-10-21 13:56:35 [DEBUG   ] summary = ERROR
2018-10-21 13:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225215  13 58412 50195897 A  ERRORERROR'
2018-10-21 13:56:36 [DEBUG   ] Got command RPT from MCS: ref #225216
2018-10-21 13:56:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:56:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225216  77 58412 50196101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:56:36 [DEBUG   ] Got command RPT from MCS: ref #225217
2018-10-21 13:56:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 13:56:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225217  12 58412 50196293 A  ERRORB–™š'
2018-10-21 13:56:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 13:56:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:56:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:56:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:56:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:56:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:56:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:56:51 [DEBUG   ] Finished updating board flags in 2.123 seconds
2018-10-21 13:57:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 13:57:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 13:57:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 13:57:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:57:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:57:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:57:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:57:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:57:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:57:51 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-10-21 13:58:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-21 13:58:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 13:58:28 [DEBUG   ] Got command RPT from MCS: ref #225222
2018-10-21 13:58:28 [DEBUG   ] summary = ERROR
2018-10-21 13:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225222  13 58412 50308613 A  ERRORERROR'
2018-10-21 13:58:28 [DEBUG   ] Got command RPT from MCS: ref #225223
2018-10-21 13:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 13:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225223  77 58412 50308614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 13:58:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 13:58:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:58:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:58:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:58:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:58:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:58:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:58:51 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-10-21 13:59:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 13:59:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 13:59:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 13:59:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 13:59:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:59:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:59:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:59:51 [WARNING ] (13, 1, 'bot')
2018-10-21 13:59:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 13:59:51 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-21 14:00:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:00:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 14:00:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 14:00:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:00:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 14:00:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:00:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:00:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:00:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:00:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:00:51 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-21 14:01:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 14:01:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 14:01:35 [DEBUG   ] Got command RPT from MCS: ref #225245
2018-10-21 14:01:35 [DEBUG   ] summary = ERROR
2018-10-21 14:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225245  13 58412 50495573 A  ERRORERROR'
2018-10-21 14:01:35 [DEBUG   ] Got command RPT from MCS: ref #225246
2018-10-21 14:01:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225246  77 58412 50495777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:01:35 [DEBUG   ] Got command RPT from MCS: ref #225247
2018-10-21 14:01:35 [DEBUG   ] summary = ERROR
2018-10-21 14:01:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225247  13 58412 50495981 A  ERRORERROR'
2018-10-21 14:01:36 [DEBUG   ] Got command RPT from MCS: ref #225249
2018-10-21 14:01:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225249  77 58412 50496173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:01:36 [DEBUG   ] Got command RPT from MCS: ref #225250
2018-10-21 14:01:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225250  12 58412 50496377 A  ERRORB”™š'
2018-10-21 14:01:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 14:01:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:01:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:01:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:01:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:01:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:01:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:01:51 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-21 14:02:09 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-21 14:02:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 14:02:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 14:02:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:02:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:02:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:02:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:02:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:02:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:02:51 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-21 14:03:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-21 14:03:28 [DEBUG   ] Got command RPT from MCS: ref #225259
2018-10-21 14:03:28 [DEBUG   ] summary = ERROR
2018-10-21 14:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225259  13 58412 50608609 A  ERRORERROR'
2018-10-21 14:03:28 [DEBUG   ] Got command RPT from MCS: ref #225260
2018-10-21 14:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225260  77 58412 50608610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:03:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 14:03:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:03:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:03:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:03:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:03:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:03:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:03:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:03:51 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-21 14:04:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:04:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 14:04:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 14:04:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:04:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:04:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:04:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:04:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:04:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:04:51 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-10-21 14:05:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 14:05:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 14:05:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 14:05:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:05:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:05:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:05:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:05:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:05:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:05:51 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-21 14:06:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 14:06:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 14:06:35 [DEBUG   ] Got command RPT from MCS: ref #225280
2018-10-21 14:06:35 [DEBUG   ] summary = ERROR
2018-10-21 14:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225280  13 58412 50795661 A  ERRORERROR'
2018-10-21 14:06:35 [DEBUG   ] Got command RPT from MCS: ref #225281
2018-10-21 14:06:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:06:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225281  77 58412 50795865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:06:36 [DEBUG   ] Got command RPT from MCS: ref #225282
2018-10-21 14:06:36 [DEBUG   ] summary = ERROR
2018-10-21 14:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225282  13 58412 50796057 A  ERRORERROR'
2018-10-21 14:06:36 [DEBUG   ] Got command RPT from MCS: ref #225283
2018-10-21 14:06:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225283  77 58412 50796261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:06:36 [DEBUG   ] Got command RPT from MCS: ref #225284
2018-10-21 14:06:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225284  12 58412 50796465 A  ERRORB”™š'
2018-10-21 14:06:50 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-21 14:06:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:06:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:06:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:06:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:06:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:06:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:06:51 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-10-21 14:07:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 14:07:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 14:07:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 14:07:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:07:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:07:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:07:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:07:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:07:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:07:51 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-10-21 14:08:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 14:08:28 [DEBUG   ] Got command RPT from MCS: ref #225285
2018-10-21 14:08:28 [DEBUG   ] summary = ERROR
2018-10-21 14:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225285  13 58412 50908613 A  ERRORERROR'
2018-10-21 14:08:28 [DEBUG   ] Got command RPT from MCS: ref #225286
2018-10-21 14:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225286  77 58412 50908614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:08:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 14:08:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 14:08:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 14:08:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:08:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:08:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:08:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:08:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:08:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:08:51 [DEBUG   ] Finished updating board flags in 1.317 seconds
2018-10-21 14:09:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 14:09:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 14:09:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 14:09:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:09:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 14:09:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:09:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:09:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:09:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:09:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:09:52 [DEBUG   ] Finished updating board flags in 2.202 seconds
2018-10-21 14:10:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:10:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 14:10:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 14:10:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:10:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:10:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:10:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:10:51 [WARNING ] (13, 1, 'bot')
2018-10-21 14:10:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:10:51 [DEBUG   ] Finished updating board flags in 1.316 seconds
2018-10-21 14:11:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 14:11:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 14:11:35 [DEBUG   ] Got command RPT from MCS: ref #225308
2018-10-21 14:11:35 [DEBUG   ] summary = ERROR
2018-10-21 14:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225308  13 58412 51095733 A  ERRORERROR'
2018-10-21 14:11:35 [DEBUG   ] Got command RPT from MCS: ref #225309
2018-10-21 14:11:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225309  77 58412 51095937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:11:36 [DEBUG   ] Got command RPT from MCS: ref #225310
2018-10-21 14:11:36 [DEBUG   ] summary = ERROR
2018-10-21 14:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225310  13 58412 51096141 A  ERRORERROR'
2018-10-21 14:11:36 [DEBUG   ] Got command RPT from MCS: ref #225312
2018-10-21 14:11:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225312  77 58412 51096345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:11:36 [DEBUG   ] Got command RPT from MCS: ref #225313
2018-10-21 14:11:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225313  12 58412 51096537 A  ERRORB–™š'
2018-10-21 14:11:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 14:11:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:11:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 14:11:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:11:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:11:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:11:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:11:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:11:52 [DEBUG   ] Finished updating board flags in 2.087 seconds
2018-10-21 14:12:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 14:12:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-21 14:12:51 [DEBUG   ] Finished updating ant stats in 1.254 seconds
2018-10-21 14:12:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:12:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:12:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:12:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:12:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:12:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:12:52 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-21 14:13:11 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2018-10-21 14:13:28 [DEBUG   ] Got command RPT from MCS: ref #225322
2018-10-21 14:13:28 [DEBUG   ] summary = ERROR
2018-10-21 14:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225322  13 58412 51208609 A  ERRORERROR'
2018-10-21 14:13:28 [DEBUG   ] Got command RPT from MCS: ref #225323
2018-10-21 14:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225323  77 58412 51208610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:13:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 14:13:51 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2018-10-21 14:13:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:13:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:13:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:13:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:13:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:13:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:13:52 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-21 14:14:11 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2018-10-21 14:14:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 14:14:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 14:14:51 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-10-21 14:14:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:14:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:14:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:14:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:14:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:14:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:14:52 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-21 14:15:11 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-10-21 14:15:31 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 14:15:51 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2018-10-21 14:15:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:15:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:15:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:15:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:15:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:15:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:15:52 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-21 14:16:12 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2018-10-21 14:16:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 14:16:35 [DEBUG   ] Got command RPT from MCS: ref #225343
2018-10-21 14:16:35 [DEBUG   ] summary = ERROR
2018-10-21 14:16:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225343  13 58412 51395817 A  ERRORERROR'
2018-10-21 14:16:36 [DEBUG   ] Got command RPT from MCS: ref #225344
2018-10-21 14:16:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225344  77 58412 51396021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:16:36 [DEBUG   ] Got command RPT from MCS: ref #225345
2018-10-21 14:16:36 [DEBUG   ] summary = ERROR
2018-10-21 14:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225345  13 58412 51396225 A  ERRORERROR'
2018-10-21 14:16:36 [DEBUG   ] Got command RPT from MCS: ref #225346
2018-10-21 14:16:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225346  77 58412 51396417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:16:36 [DEBUG   ] Got command RPT from MCS: ref #225347
2018-10-21 14:16:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225347  12 58412 51396621 A  ERRORB–™š'
2018-10-21 14:16:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:16:52 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2018-10-21 14:16:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:16:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:16:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:16:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:16:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:16:52 [DEBUG   ] Finished updating board flags in 1.678 seconds
2018-10-21 14:17:12 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2018-10-21 14:17:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 14:17:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:17:52 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-10-21 14:17:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:17:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:17:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:17:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:17:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:17:52 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-10-21 14:18:12 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-10-21 14:18:28 [DEBUG   ] Got command RPT from MCS: ref #225352
2018-10-21 14:18:28 [DEBUG   ] summary = ERROR
2018-10-21 14:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225352  13 58412 51508613 A  ERRORERROR'
2018-10-21 14:18:28 [DEBUG   ] Got command RPT from MCS: ref #225353
2018-10-21 14:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225353  77 58412 51508614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:18:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:18:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:18:52 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-10-21 14:18:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:18:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:18:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:18:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:18:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:18:52 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-10-21 14:19:12 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2018-10-21 14:19:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 14:19:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:19:52 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-10-21 14:19:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:19:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:19:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:19:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:19:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:19:52 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-10-21 14:20:12 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-10-21 14:20:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 14:20:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:20:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:20:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:20:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:20:52 [WARNING ] (13, 1, 'bot')
2018-10-21 14:20:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:20:52 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-10-21 14:20:53 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-10-21 14:21:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 14:21:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 14:21:35 [DEBUG   ] Got command RPT from MCS: ref #225375
2018-10-21 14:21:35 [DEBUG   ] summary = ERROR
2018-10-21 14:21:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225375  13 58412 51695905 A  ERRORERROR'
2018-10-21 14:21:36 [DEBUG   ] Got command RPT from MCS: ref #225376
2018-10-21 14:21:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225376  77 58412 51696097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:21:36 [DEBUG   ] Got command RPT from MCS: ref #225377
2018-10-21 14:21:36 [DEBUG   ] summary = ERROR
2018-10-21 14:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225377  13 58412 51696301 A  ERRORERROR'
2018-10-21 14:21:36 [DEBUG   ] Got command RPT from MCS: ref #225379
2018-10-21 14:21:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225379  77 58412 51696505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:21:36 [DEBUG   ] Got command RPT from MCS: ref #225380
2018-10-21 14:21:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225380  12 58412 51696709 A  ERRORB•™š'
2018-10-21 14:21:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:21:53 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2018-10-21 14:21:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:21:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:21:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:21:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:21:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:21:53 [DEBUG   ] Finished updating board flags in 2.260 seconds
2018-10-21 14:22:13 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2018-10-21 14:22:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 14:22:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:22:53 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-10-21 14:22:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 14:22:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:22:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:22:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:22:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:22:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:22:53 [DEBUG   ] Finished updating board flags in 2.194 seconds
2018-10-21 14:23:13 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-10-21 14:23:28 [DEBUG   ] Got command RPT from MCS: ref #225385
2018-10-21 14:23:28 [DEBUG   ] summary = ERROR
2018-10-21 14:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225385  13 58412 51808617 A  ERRORERROR'
2018-10-21 14:23:28 [DEBUG   ] Got command RPT from MCS: ref #225386
2018-10-21 14:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225386  77 58412 51808618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:23:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 14:23:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:23:53 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-10-21 14:23:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:23:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:23:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:23:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:23:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:23:53 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-10-21 14:24:13 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-10-21 14:24:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 14:24:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:24:53 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2018-10-21 14:24:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:24:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:24:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:24:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:24:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:24:53 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-21 14:25:13 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-10-21 14:25:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 14:25:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:25:53 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2018-10-21 14:25:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:25:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:25:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:25:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:25:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:25:53 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-21 14:26:14 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2018-10-21 14:26:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 14:26:35 [DEBUG   ] Got command RPT from MCS: ref #225406
2018-10-21 14:26:35 [DEBUG   ] summary = ERROR
2018-10-21 14:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225406  13 58412 51995981 A  ERRORERROR'
2018-10-21 14:26:36 [DEBUG   ] Got command RPT from MCS: ref #225407
2018-10-21 14:26:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225407  77 58412 51996185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:26:36 [DEBUG   ] Got command RPT from MCS: ref #225408
2018-10-21 14:26:36 [DEBUG   ] summary = ERROR
2018-10-21 14:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225408  13 58412 51996389 A  ERRORERROR'
2018-10-21 14:26:36 [DEBUG   ] Got command RPT from MCS: ref #225409
2018-10-21 14:26:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225409  77 58412 51996581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:26:36 [DEBUG   ] Got command RPT from MCS: ref #225410
2018-10-21 14:26:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225410  12 58412 51996785 A  ERRORB•™š'
2018-10-21 14:26:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:26:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:26:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:26:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:26:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:26:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:26:53 [DEBUG   ] Finished updating board flags in 1.761 seconds
2018-10-21 14:26:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 14:27:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 14:27:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 14:27:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 14:27:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:27:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:27:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:27:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:27:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:27:53 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-21 14:27:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 14:28:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 14:28:28 [DEBUG   ] Got command RPT from MCS: ref #225415
2018-10-21 14:28:28 [DEBUG   ] summary = ERROR
2018-10-21 14:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225415  13 58412 52108613 A  ERRORERROR'
2018-10-21 14:28:28 [DEBUG   ] Got command RPT from MCS: ref #225416
2018-10-21 14:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225416  77 58412 52108614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:28:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 14:28:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 14:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 14:28:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:28:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:28:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:28:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:28:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:28:53 [DEBUG   ] Finished updating board flags in 1.663 seconds
2018-10-21 14:28:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 14:29:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 14:29:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 14:29:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:29:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:29:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:29:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:29:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:29:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:29:53 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-10-21 14:29:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:30:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 14:30:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 14:30:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 14:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 14:30:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:30:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:30:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:30:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:30:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:30:53 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-10-21 14:30:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:31:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:31:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 14:31:36 [DEBUG   ] Got command RPT from MCS: ref #225438
2018-10-21 14:31:36 [DEBUG   ] summary = ERROR
2018-10-21 14:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225438  13 58412 52296065 A  ERRORERROR'
2018-10-21 14:31:36 [DEBUG   ] Got command RPT from MCS: ref #225439
2018-10-21 14:31:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225439  77 58412 52296257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:31:36 [DEBUG   ] Got command RPT from MCS: ref #225440
2018-10-21 14:31:36 [DEBUG   ] summary = ERROR
2018-10-21 14:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225440  13 58412 52296461 A  ERRORERROR'
2018-10-21 14:31:36 [DEBUG   ] Got command RPT from MCS: ref #225442
2018-10-21 14:31:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225442  77 58412 52296665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:31:36 [DEBUG   ] Got command RPT from MCS: ref #225444
2018-10-21 14:31:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225444  12 58412 52296869 A  ERRORB—™š'
2018-10-21 14:31:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:31:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:31:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:31:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:31:53 [WARNING ] (13, 1, 'bot')
2018-10-21 14:31:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:31:53 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-10-21 14:31:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 14:32:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-21 14:32:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 14:32:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:32:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 14:32:54 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2018-10-21 14:32:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:32:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:32:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:32:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:32:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:32:54 [DEBUG   ] Finished updating board flags in 2.181 seconds
2018-10-21 14:33:14 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-10-21 14:33:28 [DEBUG   ] Got command RPT from MCS: ref #225452
2018-10-21 14:33:28 [DEBUG   ] summary = ERROR
2018-10-21 14:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225452  13 58412 52408621 A  ERRORERROR'
2018-10-21 14:33:28 [DEBUG   ] Got command RPT from MCS: ref #225453
2018-10-21 14:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225453  77 58412 52408622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:33:34 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 14:33:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:33:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 14:33:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 14:33:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:33:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:33:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:33:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:33:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:33:54 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-21 14:33:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-21 14:34:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 14:34:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 14:34:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:34:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:34:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:34:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:34:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:34:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:34:54 [DEBUG   ] Finished updating board flags in 1.838 seconds
2018-10-21 14:34:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 14:35:15 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-21 14:35:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 14:35:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:35:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:35:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:35:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:35:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:35:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:35:54 [DEBUG   ] Finished updating board flags in 1.744 seconds
2018-10-21 14:35:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 14:36:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 14:36:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 14:36:36 [DEBUG   ] Got command RPT from MCS: ref #225473
2018-10-21 14:36:36 [DEBUG   ] summary = ERROR
2018-10-21 14:36:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225473  13 58412 52596145 A  ERRORERROR'
2018-10-21 14:36:36 [DEBUG   ] Got command RPT from MCS: ref #225474
2018-10-21 14:36:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:36:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225474  77 58412 52596349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:36:36 [DEBUG   ] Got command RPT from MCS: ref #225475
2018-10-21 14:36:36 [DEBUG   ] summary = ERROR
2018-10-21 14:36:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225475  13 58412 52596541 A  ERRORERROR'
2018-10-21 14:36:36 [DEBUG   ] Got command RPT from MCS: ref #225476
2018-10-21 14:36:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:36:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225476  77 58412 52596745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:36:36 [DEBUG   ] Got command RPT from MCS: ref #225477
2018-10-21 14:36:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:36:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225477  12 58412 52596949 A  ERRORB–™š'
2018-10-21 14:36:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:36:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 14:36:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:36:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:36:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:36:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:36:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:36:55 [DEBUG   ] Finished updating board flags in 2.531 seconds
2018-10-21 14:37:15 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-21 14:37:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:37:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:37:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 14:37:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:37:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:37:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:37:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:37:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:37:54 [DEBUG   ] Finished updating board flags in 1.475 seconds
2018-10-21 14:37:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 14:38:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:38:28 [DEBUG   ] Got command RPT from MCS: ref #225478
2018-10-21 14:38:28 [DEBUG   ] summary = ERROR
2018-10-21 14:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225478  13 58412 52708625 A  ERRORERROR'
2018-10-21 14:38:28 [DEBUG   ] Got command RPT from MCS: ref #225479
2018-10-21 14:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225479  77 58412 52708626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:38:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:38:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:38:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:38:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:38:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:38:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:38:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:38:54 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-21 14:38:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:39:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 14:39:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 14:39:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:39:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:39:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:39:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:39:54 [WARNING ] (13, 1, 'bot')
2018-10-21 14:39:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:39:54 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-10-21 14:39:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 14:40:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 14:40:35 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-21 14:40:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:40:55 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2018-10-21 14:40:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:40:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:40:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:40:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:40:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:40:55 [DEBUG   ] Finished updating board flags in 2.233 seconds
2018-10-21 14:41:15 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-10-21 14:41:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 14:41:36 [DEBUG   ] Got command RPT from MCS: ref #225501
2018-10-21 14:41:36 [DEBUG   ] summary = ERROR
2018-10-21 14:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225501  13 58412 52896217 A  ERRORERROR'
2018-10-21 14:41:36 [DEBUG   ] Got command RPT from MCS: ref #225502
2018-10-21 14:41:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225502  77 58412 52896421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:41:36 [DEBUG   ] Got command RPT from MCS: ref #225503
2018-10-21 14:41:36 [DEBUG   ] summary = ERROR
2018-10-21 14:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225503  13 58412 52896625 A  ERRORERROR'
2018-10-21 14:41:36 [DEBUG   ] Got command RPT from MCS: ref #225505
2018-10-21 14:41:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225505  77 58412 52896829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:41:37 [DEBUG   ] Got command RPT from MCS: ref #225506
2018-10-21 14:41:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225506  12 58412 52897021 A  ERRORB”™š'
2018-10-21 14:41:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:41:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:41:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:41:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:41:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:41:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:41:55 [DEBUG   ] Finished updating board flags in 2.190 seconds
2018-10-21 14:41:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 14:42:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 14:42:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 14:42:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:42:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:42:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:42:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:42:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:42:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:42:55 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-21 14:42:56 [DEBUG   ] Finished updating ant stats in 1.176 seconds
2018-10-21 14:43:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 14:43:28 [DEBUG   ] Got command RPT from MCS: ref #225515
2018-10-21 14:43:28 [DEBUG   ] summary = ERROR
2018-10-21 14:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225515  13 58412 53008621 A  ERRORERROR'
2018-10-21 14:43:28 [DEBUG   ] Got command RPT from MCS: ref #225516
2018-10-21 14:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225516  77 58412 53008622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:43:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 14:43:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:43:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:43:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:43:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:43:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:43:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:43:55 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-21 14:43:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 14:44:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 14:44:36 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 14:44:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:44:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:44:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:44:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:44:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:44:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:44:55 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-10-21 14:44:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:45:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 14:45:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 14:45:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:45:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:45:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:45:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:45:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:45:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:45:55 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-21 14:45:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 14:46:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 14:46:36 [DEBUG   ] Got command RPT from MCS: ref #225536
2018-10-21 14:46:36 [DEBUG   ] summary = ERROR
2018-10-21 14:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225536  13 58412 53196305 A  ERRORERROR'
2018-10-21 14:46:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 14:46:36 [DEBUG   ] Got command RPT from MCS: ref #225537
2018-10-21 14:46:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225537  77 58412 53196509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:46:36 [DEBUG   ] Got command RPT from MCS: ref #225538
2018-10-21 14:46:36 [DEBUG   ] summary = ERROR
2018-10-21 14:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225538  13 58412 53196701 A  ERRORERROR'
2018-10-21 14:46:36 [DEBUG   ] Got command RPT from MCS: ref #225539
2018-10-21 14:46:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:46:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225539  77 58412 53196905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:46:37 [DEBUG   ] Got command RPT from MCS: ref #225540
2018-10-21 14:46:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225540  12 58412 53197109 A  ERRORB”™š'
2018-10-21 14:46:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:46:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:46:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:46:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:46:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:46:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:46:55 [DEBUG   ] Finished updating board flags in 1.704 seconds
2018-10-21 14:46:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 14:47:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 14:47:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 14:47:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:47:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:47:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:47:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:47:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:47:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:47:55 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-10-21 14:47:57 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 14:48:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 14:48:28 [DEBUG   ] Got command RPT from MCS: ref #225545
2018-10-21 14:48:28 [DEBUG   ] summary = ERROR
2018-10-21 14:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225545  13 58412 53308621 A  ERRORERROR'
2018-10-21 14:48:28 [DEBUG   ] Got command RPT from MCS: ref #225546
2018-10-21 14:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225546  77 58412 53308622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:48:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 14:48:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:48:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:48:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:48:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:48:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:48:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:48:55 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-10-21 14:48:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 14:49:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 14:49:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 14:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:49:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:49:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:49:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:49:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:49:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:49:55 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-10-21 14:49:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 14:50:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 14:50:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 14:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:50:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:50:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:50:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:50:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:50:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:50:55 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-10-21 14:50:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 14:51:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 14:51:36 [DEBUG   ] Got command RPT from MCS: ref #225568
2018-10-21 14:51:36 [DEBUG   ] summary = ERROR
2018-10-21 14:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225568  13 58412 53496378 A  ERRORERROR'
2018-10-21 14:51:36 [DEBUG   ] Got command RPT from MCS: ref #225569
2018-10-21 14:51:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225569  77 58412 53496766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:51:36 [DEBUG   ] Got command RPT from MCS: ref #225570
2018-10-21 14:51:36 [DEBUG   ] summary = ERROR
2018-10-21 14:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225570  13 58412 53496789 A  ERRORERROR'
2018-10-21 14:51:36 [DEBUG   ] Got command RPT from MCS: ref #225572
2018-10-21 14:51:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225572  77 58412 53496981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:51:37 [DEBUG   ] Got command RPT from MCS: ref #225574
2018-10-21 14:51:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225574  12 58412 53497185 A  ERRORB–™š'
2018-10-21 14:51:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 14:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:51:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:51:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:51:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:51:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:51:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:51:55 [DEBUG   ] Finished updating board flags in 1.460 seconds
2018-10-21 14:51:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 14:52:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 14:52:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 14:52:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 14:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 14:52:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:52:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:52:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:52:55 [WARNING ] (13, 1, 'bot')
2018-10-21 14:52:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:52:55 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-10-21 14:52:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 14:53:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 14:53:28 [DEBUG   ] Got command RPT from MCS: ref #225578
2018-10-21 14:53:28 [DEBUG   ] summary = ERROR
2018-10-21 14:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225578  13 58412 53608617 A  ERRORERROR'
2018-10-21 14:53:28 [DEBUG   ] Got command RPT from MCS: ref #225579
2018-10-21 14:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225579  77 58412 53608618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:53:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 14:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:53:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:53:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:53:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:53:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:53:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:53:56 [DEBUG   ] Finished updating board flags in 2.202 seconds
2018-10-21 14:53:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:54:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 14:54:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 14:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:54:57 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-21 14:54:57 [WARNING ] (13, 1, 'bot')
2018-10-21 14:54:57 [WARNING ] (13, 1, 'bot')
2018-10-21 14:54:57 [WARNING ] (13, 1, 'bot')
2018-10-21 14:54:57 [WARNING ] (13, 1, 'bot')
2018-10-21 14:54:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:54:57 [DEBUG   ] Finished updating board flags in 2.972 seconds
2018-10-21 14:55:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 14:55:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 14:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:55:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 14:55:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:55:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:55:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:55:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:55:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:55:56 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-10-21 14:55:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 14:56:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 14:56:36 [DEBUG   ] Got command RPT from MCS: ref #225599
2018-10-21 14:56:36 [DEBUG   ] summary = ERROR
2018-10-21 14:56:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225599  13 58412 53796469 A  ERRORERROR'
2018-10-21 14:56:36 [DEBUG   ] Got command RPT from MCS: ref #225600
2018-10-21 14:56:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:56:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225600  77 58412 53796661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:56:36 [DEBUG   ] Got command RPT from MCS: ref #225601
2018-10-21 14:56:36 [DEBUG   ] summary = ERROR
2018-10-21 14:56:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225601  13 58412 53796865 A  ERRORERROR'
2018-10-21 14:56:37 [DEBUG   ] Got command RPT from MCS: ref #225602
2018-10-21 14:56:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225602  77 58412 53797069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:56:37 [DEBUG   ] Got command RPT from MCS: ref #225603
2018-10-21 14:56:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 14:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225603  12 58412 53797273 A  ERRORB–™š'
2018-10-21 14:56:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 14:56:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:56:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:56:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:56:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:56:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:56:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:56:56 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-21 14:56:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 14:57:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 14:57:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 14:57:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:57:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 14:57:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:57:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:57:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:57:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:57:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:57:56 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-10-21 14:57:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 14:58:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 14:58:28 [DEBUG   ] Got command RPT from MCS: ref #225608
2018-10-21 14:58:28 [DEBUG   ] summary = ERROR
2018-10-21 14:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225608  13 58412 53908621 A  ERRORERROR'
2018-10-21 14:58:28 [DEBUG   ] Got command RPT from MCS: ref #225609
2018-10-21 14:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 14:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225609  77 58412 53908622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 14:58:38 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-21 14:58:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:58:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:58:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:58:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:58:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:58:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:58:56 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-10-21 14:58:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 14:59:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 14:59:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 14:59:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 14:59:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 14:59:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:59:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:59:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:59:56 [WARNING ] (13, 1, 'bot')
2018-10-21 14:59:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 14:59:56 [DEBUG   ] Finished updating board flags in 1.577 seconds
2018-10-21 14:59:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 15:00:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 15:00:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 15:00:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:00:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:00:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:00:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:00:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:00:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:00:56 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-10-21 15:00:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 15:01:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 15:01:36 [DEBUG   ] Got command RPT from MCS: ref #225631
2018-10-21 15:01:36 [DEBUG   ] summary = ERROR
2018-10-21 15:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225631  13 58412 54096549 A  ERRORERROR'
2018-10-21 15:01:36 [DEBUG   ] Got command RPT from MCS: ref #225632
2018-10-21 15:01:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225632  77 58412 54096753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:01:36 [DEBUG   ] Got command RPT from MCS: ref #225633
2018-10-21 15:01:36 [DEBUG   ] summary = ERROR
2018-10-21 15:01:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225633  13 58412 54096945 A  ERRORERROR'
2018-10-21 15:01:37 [DEBUG   ] Got command RPT from MCS: ref #225635
2018-10-21 15:01:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225635  77 58412 54097149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:01:37 [DEBUG   ] Got command RPT from MCS: ref #225636
2018-10-21 15:01:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225636  12 58412 54097353 A  ERRORB•™š'
2018-10-21 15:01:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 15:01:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:01:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:01:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:01:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:01:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:01:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:01:56 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-21 15:01:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 15:02:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 15:02:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 15:02:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:02:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:02:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:02:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:02:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:02:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:02:56 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-10-21 15:02:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 15:03:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 15:03:28 [DEBUG   ] Got command RPT from MCS: ref #225645
2018-10-21 15:03:28 [DEBUG   ] summary = ERROR
2018-10-21 15:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225645  13 58412 54208629 A  ERRORERROR'
2018-10-21 15:03:28 [DEBUG   ] Got command RPT from MCS: ref #225646
2018-10-21 15:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225646  77 58412 54208630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:03:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 15:03:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:03:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:03:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:03:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:03:56 [WARNING ] (13, 1, 'bot')
2018-10-21 15:03:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:03:56 [DEBUG   ] Finished updating board flags in 1.512 seconds
2018-10-21 15:03:58 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-21 15:04:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 15:04:39 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 15:04:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:04:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:04:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:04:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:04:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:04:57 [DEBUG   ] Finished updating board flags in 2.247 seconds
2018-10-21 15:04:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 15:05:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:05:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 15:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:05:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:05:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:05:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:05:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:05:57 [DEBUG   ] Finished updating board flags in 2.134 seconds
2018-10-21 15:05:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 15:06:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 15:06:36 [DEBUG   ] Got command RPT from MCS: ref #225666
2018-10-21 15:06:36 [DEBUG   ] summary = ERROR
2018-10-21 15:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225666  13 58412 54396629 A  ERRORERROR'
2018-10-21 15:06:36 [DEBUG   ] Got command RPT from MCS: ref #225667
2018-10-21 15:06:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:06:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225667  77 58412 54396821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:06:37 [DEBUG   ] Got command RPT from MCS: ref #225668
2018-10-21 15:06:37 [DEBUG   ] summary = ERROR
2018-10-21 15:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225668  13 58412 54397025 A  ERRORERROR'
2018-10-21 15:06:37 [DEBUG   ] Got command RPT from MCS: ref #225669
2018-10-21 15:06:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225669  77 58412 54397229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:06:37 [DEBUG   ] Got command RPT from MCS: ref #225670
2018-10-21 15:06:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225670  12 58412 54397433 A  ERRORB”™š'
2018-10-21 15:06:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:06:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:06:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:06:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:06:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:06:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:06:57 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-10-21 15:06:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 15:07:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 15:07:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:07:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 15:07:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:07:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:07:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:07:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:07:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:07:57 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-10-21 15:07:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:08:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 15:08:28 [DEBUG   ] Got command RPT from MCS: ref #225671
2018-10-21 15:08:28 [DEBUG   ] summary = ERROR
2018-10-21 15:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225671  13 58412 54508629 A  ERRORERROR'
2018-10-21 15:08:28 [DEBUG   ] Got command RPT from MCS: ref #225672
2018-10-21 15:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225672  77 58412 54508630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:08:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:08:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:08:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:08:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:08:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:08:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:08:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:08:57 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-21 15:08:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 15:09:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:09:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 15:09:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:09:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:09:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:09:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:09:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:09:57 [DEBUG   ] Finished updating board flags in 1.939 seconds
2018-10-21 15:09:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 15:10:19 [DEBUG   ] Finished updating ant stats in 0.786 seconds
2018-10-21 15:10:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 15:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:10:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:10:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:10:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:10:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:10:57 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-10-21 15:10:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 15:11:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 15:11:36 [DEBUG   ] Got command RPT from MCS: ref #225694
2018-10-21 15:11:36 [DEBUG   ] summary = ERROR
2018-10-21 15:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225694  13 58412 54696705 A  ERRORERROR'
2018-10-21 15:11:36 [DEBUG   ] Got command RPT from MCS: ref #225695
2018-10-21 15:11:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:11:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225695  77 58412 54696909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:11:37 [DEBUG   ] Got command RPT from MCS: ref #225696
2018-10-21 15:11:37 [DEBUG   ] summary = ERROR
2018-10-21 15:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225696  13 58412 54697101 A  ERRORERROR'
2018-10-21 15:11:37 [DEBUG   ] Got command RPT from MCS: ref #225698
2018-10-21 15:11:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225698  77 58412 54697305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:11:37 [DEBUG   ] Got command RPT from MCS: ref #225700
2018-10-21 15:11:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225700  12 58412 54697509 A  ERRORB”™š'
2018-10-21 15:11:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 15:11:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-21 15:11:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:11:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:11:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:11:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:11:57 [WARNING ] (25, 5, 'bot')
2018-10-21 15:11:57 [WARNING ] (25, 5, 'bot')
2018-10-21 15:11:57 [WARNING ] (25, 5, 'bot')
2018-10-21 15:11:57 [WARNING ] (25, 5, 'bot')
2018-10-21 15:11:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:11:57 [DEBUG   ] Finished updating board flags in 1.764 seconds
2018-10-21 15:12:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 15:12:20 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 15:12:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:12:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:12:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 15:12:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:12:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:12:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:12:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:12:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:12:57 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-21 15:13:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 15:13:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 15:13:28 [DEBUG   ] Got command RPT from MCS: ref #225708
2018-10-21 15:13:28 [DEBUG   ] summary = ERROR
2018-10-21 15:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225708  13 58412 54808629 A  ERRORERROR'
2018-10-21 15:13:28 [DEBUG   ] Got command RPT from MCS: ref #225709
2018-10-21 15:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225709  77 58412 54808630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:13:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:13:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:13:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:13:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:13:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:13:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:13:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:13:57 [DEBUG   ] Finished updating board flags in 1.649 seconds
2018-10-21 15:14:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:14:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 15:14:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 15:14:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:14:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:14:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:14:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:14:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:14:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:14:57 [DEBUG   ] Finished updating board flags in 1.547 seconds
2018-10-21 15:15:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 15:15:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:15:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 15:15:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:15:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 15:15:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:15:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:15:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:15:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:15:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:15:57 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-10-21 15:16:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 15:16:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 15:16:36 [DEBUG   ] Got command RPT from MCS: ref #225729
2018-10-21 15:16:36 [DEBUG   ] summary = ERROR
2018-10-21 15:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225729  13 58412 54996789 A  ERRORERROR'
2018-10-21 15:16:36 [DEBUG   ] Got command RPT from MCS: ref #225730
2018-10-21 15:16:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225730  77 58412 54996981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:16:37 [DEBUG   ] Got command RPT from MCS: ref #225731
2018-10-21 15:16:37 [DEBUG   ] summary = ERROR
2018-10-21 15:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225731  13 58412 54997185 A  ERRORERROR'
2018-10-21 15:16:37 [DEBUG   ] Got command RPT from MCS: ref #225732
2018-10-21 15:16:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225732  77 58412 54997389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:16:37 [DEBUG   ] Got command RPT from MCS: ref #225733
2018-10-21 15:16:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225733  12 58412 54997581 A  ERRORB”™š'
2018-10-21 15:16:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:16:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 15:16:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:16:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:16:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:16:57 [WARNING ] (13, 1, 'bot')
2018-10-21 15:16:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:16:57 [DEBUG   ] Finished updating board flags in 1.540 seconds
2018-10-21 15:17:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:17:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 15:17:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 15:17:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:17:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:17:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:17:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:17:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:17:58 [DEBUG   ] Finished updating board flags in 2.282 seconds
2018-10-21 15:18:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:18:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:18:28 [DEBUG   ] Got command RPT from MCS: ref #225738
2018-10-21 15:18:28 [DEBUG   ] summary = ERROR
2018-10-21 15:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225738  13 58412 55108648 A  ERRORERROR'
2018-10-21 15:18:28 [DEBUG   ] Got command RPT from MCS: ref #225739
2018-10-21 15:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225739  77 58412 55108648 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:18:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 15:18:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:18:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:18:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:18:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:18:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:18:58 [DEBUG   ] Finished updating board flags in 2.235 seconds
2018-10-21 15:19:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:19:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:19:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:19:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:19:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:19:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:19:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:19:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:19:58 [DEBUG   ] Finished updating board flags in 1.969 seconds
2018-10-21 15:20:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 15:20:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:20:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:20:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:20:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:20:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:20:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:20:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:20:58 [DEBUG   ] Finished updating board flags in 1.835 seconds
2018-10-21 15:21:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 15:21:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 15:21:36 [DEBUG   ] Got command RPT from MCS: ref #225761
2018-10-21 15:21:36 [DEBUG   ] summary = ERROR
2018-10-21 15:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225761  13 58412 55296861 A  ERRORERROR'
2018-10-21 15:21:37 [DEBUG   ] Got command RPT from MCS: ref #225762
2018-10-21 15:21:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225762  77 58412 55297065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:21:37 [DEBUG   ] Got command RPT from MCS: ref #225763
2018-10-21 15:21:37 [DEBUG   ] summary = ERROR
2018-10-21 15:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225763  13 58412 55297269 A  ERRORERROR'
2018-10-21 15:21:37 [DEBUG   ] Got command RPT from MCS: ref #225765
2018-10-21 15:21:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225765  77 58412 55297461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:21:37 [DEBUG   ] Got command RPT from MCS: ref #225766
2018-10-21 15:21:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225766  12 58412 55297665 A  ERRORB–™š'
2018-10-21 15:21:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 15:21:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 15:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:21:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:21:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:21:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:21:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:21:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:21:58 [DEBUG   ] Finished updating board flags in 1.768 seconds
2018-10-21 15:22:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:22:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 15:22:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 15:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:22:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 15:22:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:22:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:22:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:22:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:22:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:22:58 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-21 15:23:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:23:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:23:28 [DEBUG   ] Got command RPT from MCS: ref #225771
2018-10-21 15:23:28 [DEBUG   ] summary = ERROR
2018-10-21 15:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225771  13 58412 55408625 A  ERRORERROR'
2018-10-21 15:23:28 [DEBUG   ] Got command RPT from MCS: ref #225772
2018-10-21 15:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225772  77 58412 55408626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:23:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 15:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:23:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:23:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:23:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:23:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:23:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:23:58 [DEBUG   ] Finished updating board flags in 1.577 seconds
2018-10-21 15:24:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 15:24:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:24:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:24:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:24:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:24:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:24:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:24:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:24:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:24:58 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-10-21 15:25:00 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 15:25:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 15:25:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 15:25:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:25:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:25:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:25:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:25:58 [WARNING ] (13, 1, 'bot')
2018-10-21 15:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:25:58 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-21 15:26:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 15:26:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 15:26:36 [DEBUG   ] Got command RPT from MCS: ref #225792
2018-10-21 15:26:36 [DEBUG   ] summary = ERROR
2018-10-21 15:26:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225792  13 58412 55596945 A  ERRORERROR'
2018-10-21 15:26:37 [DEBUG   ] Got command RPT from MCS: ref #225793
2018-10-21 15:26:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225793  77 58412 55597149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:26:37 [DEBUG   ] Got command RPT from MCS: ref #225794
2018-10-21 15:26:37 [DEBUG   ] summary = ERROR
2018-10-21 15:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225794  13 58412 55597341 A  ERRORERROR'
2018-10-21 15:26:37 [DEBUG   ] Got command RPT from MCS: ref #225795
2018-10-21 15:26:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225795  77 58412 55597545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:26:37 [DEBUG   ] Got command RPT from MCS: ref #225796
2018-10-21 15:26:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225796  12 58412 55597749 A  ERRORB–™š'
2018-10-21 15:26:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 15:26:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:26:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:26:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:26:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:26:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:26:59 [DEBUG   ] Finished updating board flags in 2.184 seconds
2018-10-21 15:27:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 15:27:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 15:27:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 15:27:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:27:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:27:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:27:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:27:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:27:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:27:59 [DEBUG   ] Finished updating board flags in 1.889 seconds
2018-10-21 15:28:01 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 15:28:21 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 15:28:28 [DEBUG   ] Got command RPT from MCS: ref #225801
2018-10-21 15:28:28 [DEBUG   ] summary = ERROR
2018-10-21 15:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225801  13 58412 55708633 A  ERRORERROR'
2018-10-21 15:28:28 [DEBUG   ] Got command RPT from MCS: ref #225802
2018-10-21 15:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225802  77 58412 55708634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:28:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 15:28:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:28:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:28:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:28:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:28:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:28:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:28:59 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-21 15:29:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 15:29:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 15:29:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:29:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:29:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:29:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:29:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:29:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:29:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:29:59 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-10-21 15:30:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-21 15:30:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 15:30:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 15:30:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:30:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:30:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:30:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:30:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:30:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:30:59 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-21 15:31:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 15:31:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 15:31:37 [DEBUG   ] Got command RPT from MCS: ref #225824
2018-10-21 15:31:37 [DEBUG   ] summary = ERROR
2018-10-21 15:31:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225824  13 58412 55897025 A  ERRORERROR'
2018-10-21 15:31:39 [DEBUG   ] Got command RPT from MCS: ref #225827
2018-10-21 15:31:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225827  77 58412 55899041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:31:39 [DEBUG   ] Got command RPT from MCS: ref #225829
2018-10-21 15:31:39 [DEBUG   ] summary = ERROR
2018-10-21 15:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225829  13 58412 55899233 A  ERRORERROR'
2018-10-21 15:31:39 [DEBUG   ] Got command RPT from MCS: ref #225830
2018-10-21 15:31:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225830  77 58412 55899437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:31:39 [DEBUG   ] Got command RPT from MCS: ref #225832
2018-10-21 15:31:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225832  12 58412 55899641 A  ERRORB•™š'
2018-10-21 15:31:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 15:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:31:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 15:31:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:31:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:31:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:31:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:31:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:31:59 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-10-21 15:32:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 15:32:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 15:32:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 15:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:32:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:32:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:32:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:32:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:32:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:32:59 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-10-21 15:33:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-21 15:33:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 15:33:28 [DEBUG   ] Got command RPT from MCS: ref #225838
2018-10-21 15:33:28 [DEBUG   ] summary = ERROR
2018-10-21 15:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225838  13 58412 56008625 A  ERRORERROR'
2018-10-21 15:33:28 [DEBUG   ] Got command RPT from MCS: ref #225839
2018-10-21 15:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225839  77 58412 56008626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:33:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 15:33:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:33:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:33:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:33:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:33:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:33:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:33:59 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-10-21 15:34:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 15:34:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 15:34:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-21 15:34:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-21 15:34:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:34:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:34:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:34:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:34:59 [WARNING ] (25, 5, 'bot')
2018-10-21 15:34:59 [WARNING ] (25, 5, 'bot')
2018-10-21 15:34:59 [WARNING ] (25, 5, 'bot')
2018-10-21 15:34:59 [WARNING ] (25, 5, 'bot')
2018-10-21 15:34:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:34:59 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-10-21 15:35:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 15:35:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 15:35:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 15:35:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:35:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:35:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:35:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:35:59 [WARNING ] (13, 1, 'bot')
2018-10-21 15:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:35:59 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-10-21 15:36:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 15:36:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 15:36:37 [DEBUG   ] Got command RPT from MCS: ref #225859
2018-10-21 15:36:37 [DEBUG   ] summary = ERROR
2018-10-21 15:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225859  13 58412 56197117 A  ERRORERROR'
2018-10-21 15:36:37 [DEBUG   ] Got command RPT from MCS: ref #225860
2018-10-21 15:36:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225860  77 58412 56197309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:36:37 [DEBUG   ] Got command RPT from MCS: ref #225861
2018-10-21 15:36:37 [DEBUG   ] summary = ERROR
2018-10-21 15:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225861  13 58412 56197513 A  ERRORERROR'
2018-10-21 15:36:37 [DEBUG   ] Got command RPT from MCS: ref #225862
2018-10-21 15:36:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225862  77 58412 56197717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:36:37 [DEBUG   ] Got command RPT from MCS: ref #225863
2018-10-21 15:36:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:36:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225863  12 58412 56197909 A  ERRORB”™š'
2018-10-21 15:36:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 15:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:37:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:37:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:37:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:37:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:37:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:37:00 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-21 15:37:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 15:37:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:37:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 15:37:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:38:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:38:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:38:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:38:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:38:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:38:00 [DEBUG   ] Finished updating board flags in 2.056 seconds
2018-10-21 15:38:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 15:38:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:38:28 [DEBUG   ] Got command RPT from MCS: ref #225864
2018-10-21 15:38:28 [DEBUG   ] summary = ERROR
2018-10-21 15:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225864  13 58412 56308637 A  ERRORERROR'
2018-10-21 15:38:28 [DEBUG   ] Got command RPT from MCS: ref #225865
2018-10-21 15:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225865  77 58412 56308638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:38:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:39:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:39:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:39:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:39:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:39:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:39:00 [DEBUG   ] Finished updating board flags in 2.032 seconds
2018-10-21 15:39:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 15:39:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 15:39:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:39:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:40:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:40:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:40:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:40:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:40:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:40:00 [DEBUG   ] Finished updating board flags in 1.918 seconds
2018-10-21 15:40:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:40:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 15:40:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 15:40:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:41:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 15:41:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:41:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:41:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:41:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:41:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:41:00 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-10-21 15:41:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:41:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:41:37 [DEBUG   ] Got command RPT from MCS: ref #225887
2018-10-21 15:41:37 [DEBUG   ] summary = ERROR
2018-10-21 15:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225887  13 58412 56497193 A  ERRORERROR'
2018-10-21 15:41:37 [DEBUG   ] Got command RPT from MCS: ref #225888
2018-10-21 15:41:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225888  77 58412 56497385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:41:37 [DEBUG   ] Got command RPT from MCS: ref #225889
2018-10-21 15:41:37 [DEBUG   ] summary = ERROR
2018-10-21 15:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225889  13 58412 56497589 A  ERRORERROR'
2018-10-21 15:41:37 [DEBUG   ] Got command RPT from MCS: ref #225891
2018-10-21 15:41:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225891  77 58412 56497793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:41:37 [DEBUG   ] Got command RPT from MCS: ref #225892
2018-10-21 15:41:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:41:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225892  12 58412 56497997 A  ERRORB“™š'
2018-10-21 15:41:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 15:41:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:42:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:42:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:42:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:42:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:42:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:42:00 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-10-21 15:42:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 15:42:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 15:42:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 15:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:43:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:43:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:43:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:43:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:43:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:43:00 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-10-21 15:43:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 15:43:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 15:43:28 [DEBUG   ] Got command RPT from MCS: ref #225901
2018-10-21 15:43:28 [DEBUG   ] summary = ERROR
2018-10-21 15:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225901  13 58412 56608633 A  ERRORERROR'
2018-10-21 15:43:28 [DEBUG   ] Got command RPT from MCS: ref #225902
2018-10-21 15:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225902  77 58412 56608634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:43:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 15:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:44:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:44:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:44:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:44:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:44:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:44:00 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-10-21 15:44:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 15:44:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 15:44:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 15:44:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:45:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:45:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:45:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:45:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:45:00 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-10-21 15:45:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 15:45:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 15:45:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 15:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-21 15:46:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:46:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:46:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:46:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:46:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:46:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:46:00 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-10-21 15:46:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 15:46:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 15:46:37 [DEBUG   ] Got command RPT from MCS: ref #225922
2018-10-21 15:46:37 [DEBUG   ] summary = ERROR
2018-10-21 15:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225922  13 58412 56797273 A  ERRORERROR'
2018-10-21 15:46:37 [DEBUG   ] Got command RPT from MCS: ref #225923
2018-10-21 15:46:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225923  77 58412 56797477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:46:37 [DEBUG   ] Got command RPT from MCS: ref #225924
2018-10-21 15:46:37 [DEBUG   ] summary = ERROR
2018-10-21 15:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225924  13 58412 56797669 A  ERRORERROR'
2018-10-21 15:46:37 [DEBUG   ] Got command RPT from MCS: ref #225925
2018-10-21 15:46:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:46:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225925  77 58412 56797873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:46:38 [DEBUG   ] Got command RPT from MCS: ref #225926
2018-10-21 15:46:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225926  12 58412 56798077 A  ERRORB•™š'
2018-10-21 15:46:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 15:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:47:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:47:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:47:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:47:00 [WARNING ] (13, 1, 'bot')
2018-10-21 15:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:47:00 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-10-21 15:47:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 15:47:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 15:47:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 15:48:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 15:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 15:48:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:48:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:48:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:48:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:48:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:48:01 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-10-21 15:48:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 15:48:22 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 15:48:28 [DEBUG   ] Got command RPT from MCS: ref #225931
2018-10-21 15:48:28 [DEBUG   ] summary = ERROR
2018-10-21 15:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225931  13 58412 56908629 A  ERRORERROR'
2018-10-21 15:48:28 [DEBUG   ] Got command RPT from MCS: ref #225932
2018-10-21 15:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225932  77 58412 56908641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:48:43 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 15:49:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:49:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:49:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:49:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:49:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:49:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:49:01 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-10-21 15:49:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 15:49:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 15:49:43 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 15:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:50:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:50:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:50:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:50:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:50:01 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-21 15:50:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:50:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 15:50:43 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-21 15:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 15:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:51:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 15:51:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:51:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:51:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:51:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:51:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:51:01 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-10-21 15:51:03 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 15:51:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 15:51:37 [DEBUG   ] Got command RPT from MCS: ref #225954
2018-10-21 15:51:37 [DEBUG   ] summary = ERROR
2018-10-21 15:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225954  13 58412 57097345 A  ERRORERROR'
2018-10-21 15:51:37 [DEBUG   ] Got command RPT from MCS: ref #225955
2018-10-21 15:51:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225955  77 58412 57097549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:51:37 [DEBUG   ] Got command RPT from MCS: ref #225956
2018-10-21 15:51:37 [DEBUG   ] summary = ERROR
2018-10-21 15:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225956  13 58412 57097753 A  ERRORERROR'
2018-10-21 15:51:37 [DEBUG   ] Got command RPT from MCS: ref #225958
2018-10-21 15:51:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225958  77 58412 57097957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:51:38 [DEBUG   ] Got command RPT from MCS: ref #225959
2018-10-21 15:51:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225959  12 58412 57098149 A  ERRORB–™š'
2018-10-21 15:51:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 15:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:52:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:52:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:52:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:52:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:52:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:52:01 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-21 15:52:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 15:52:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 15:52:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 15:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:53:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:53:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:53:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:53:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:53:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:53:01 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-21 15:53:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 15:53:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 15:53:28 [DEBUG   ] Got command RPT from MCS: ref #225964
2018-10-21 15:53:28 [DEBUG   ] summary = ERROR
2018-10-21 15:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225964  13 58412 57208641 A  ERRORERROR'
2018-10-21 15:53:28 [DEBUG   ] Got command RPT from MCS: ref #225965
2018-10-21 15:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225965  77 58412 57208642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:53:43 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 15:54:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:54:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:54:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:54:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:54:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:54:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:54:01 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-10-21 15:54:03 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 15:54:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-21 15:54:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 15:55:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:55:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:55:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:55:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:55:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:55:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:55:01 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-10-21 15:55:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 15:55:24 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 15:55:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-21 15:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:56:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:56:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:56:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:56:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:56:01 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-21 15:56:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 15:56:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 15:56:37 [DEBUG   ] Got command RPT from MCS: ref #225985
2018-10-21 15:56:37 [DEBUG   ] summary = ERROR
2018-10-21 15:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225985  13 58412 57397429 A  ERRORERROR'
2018-10-21 15:56:37 [DEBUG   ] Got command RPT from MCS: ref #225986
2018-10-21 15:56:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225986  77 58412 57397633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:56:37 [DEBUG   ] Got command RPT from MCS: ref #225987
2018-10-21 15:56:37 [DEBUG   ] summary = ERROR
2018-10-21 15:56:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225987  13 58412 57397837 A  ERRORERROR'
2018-10-21 15:56:38 [DEBUG   ] Got command RPT from MCS: ref #225988
2018-10-21 15:56:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225988  77 58412 57398029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:56:38 [DEBUG   ] Got command RPT from MCS: ref #225989
2018-10-21 15:56:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 15:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225989  12 58412 57398233 A  ERRORB•™š'
2018-10-21 15:56:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 15:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:57:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:57:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:57:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:57:01 [WARNING ] (13, 1, 'bot')
2018-10-21 15:57:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:57:01 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-10-21 15:57:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 15:57:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 15:57:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 15:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:58:02 [WARNING ] (13, 1, 'bot')
2018-10-21 15:58:02 [WARNING ] (13, 1, 'bot')
2018-10-21 15:58:02 [WARNING ] (13, 1, 'bot')
2018-10-21 15:58:02 [WARNING ] (13, 1, 'bot')
2018-10-21 15:58:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:58:02 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-10-21 15:58:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 15:58:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 15:58:28 [DEBUG   ] Got command RPT from MCS: ref #225994
2018-10-21 15:58:28 [DEBUG   ] summary = ERROR
2018-10-21 15:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225994  13 58412 57508641 A  ERRORERROR'
2018-10-21 15:58:28 [DEBUG   ] Got command RPT from MCS: ref #225995
2018-10-21 15:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 15:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   225995  77 58412 57508642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 15:58:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 15:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 15:59:02 [WARNING ] (13, 1, 'bot')
2018-10-21 15:59:02 [WARNING ] (13, 1, 'bot')
2018-10-21 15:59:02 [WARNING ] (13, 1, 'bot')
2018-10-21 15:59:02 [WARNING ] (13, 1, 'bot')
2018-10-21 15:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 15:59:02 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-10-21 15:59:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 15:59:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 15:59:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 16:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:00:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2018-10-21 16:00:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:00:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:00:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:00:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:00:02 [WARNING ] (23, 5, 'bot')
2018-10-21 16:00:02 [WARNING ] (23, 5, 'bot')
2018-10-21 16:00:02 [WARNING ] (23, 5, 'bot')
2018-10-21 16:00:02 [WARNING ] (23, 5, 'bot')
2018-10-21 16:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:00:02 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-10-21 16:00:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 16:00:24 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-21 16:00:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 16:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:01:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:01:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:01:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:01:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:01:02 [DEBUG   ] Finished updating board flags in 1.945 seconds
2018-10-21 16:01:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 16:01:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 16:01:37 [DEBUG   ] Got command RPT from MCS: ref #226017
2018-10-21 16:01:37 [DEBUG   ] summary = ERROR
2018-10-21 16:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226017  13 58412 57697505 A  ERRORERROR'
2018-10-21 16:01:37 [DEBUG   ] Got command RPT from MCS: ref #226018
2018-10-21 16:01:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226018  77 58412 57697709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:01:37 [DEBUG   ] Got command RPT from MCS: ref #226019
2018-10-21 16:01:37 [DEBUG   ] summary = ERROR
2018-10-21 16:01:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226019  13 58412 57697913 A  ERRORERROR'
2018-10-21 16:01:38 [DEBUG   ] Got command RPT from MCS: ref #226020
2018-10-21 16:01:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226020  77 58412 57698105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:01:38 [DEBUG   ] Got command RPT from MCS: ref #226022
2018-10-21 16:01:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226022  12 58412 57698309 A  ERRORB”™š'
2018-10-21 16:01:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 16:02:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:02:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:02:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:02:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:02:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:02:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:02:02 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-10-21 16:02:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 16:02:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 16:02:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 16:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:03:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:03:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:03:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:03:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:03:02 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-21 16:03:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 16:03:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 16:03:28 [DEBUG   ] Got command RPT from MCS: ref #226031
2018-10-21 16:03:28 [DEBUG   ] summary = ERROR
2018-10-21 16:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226031  13 58412 57808637 A  ERRORERROR'
2018-10-21 16:03:28 [DEBUG   ] Got command RPT from MCS: ref #226032
2018-10-21 16:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226032  77 58412 57808638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:03:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 16:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:04:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:04:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:04:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:04:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:04:02 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-21 16:04:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:04:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:04:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 16:05:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:05:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:05:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:05:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:05:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:05:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:05:02 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-21 16:05:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 16:05:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:05:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:06:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:06:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:06:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:06:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:06:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:06:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:06:02 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-10-21 16:06:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 16:06:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 16:06:37 [DEBUG   ] Got command RPT from MCS: ref #226052
2018-10-21 16:06:37 [DEBUG   ] summary = ERROR
2018-10-21 16:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226052  13 58412 57997585 A  ERRORERROR'
2018-10-21 16:06:37 [DEBUG   ] Got command RPT from MCS: ref #226053
2018-10-21 16:06:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226053  77 58412 57997789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:06:37 [DEBUG   ] Got command RPT from MCS: ref #226054
2018-10-21 16:06:37 [DEBUG   ] summary = ERROR
2018-10-21 16:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226054  13 58412 57997993 A  ERRORERROR'
2018-10-21 16:06:38 [DEBUG   ] Got command RPT from MCS: ref #226055
2018-10-21 16:06:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226055  77 58412 57998185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:06:38 [DEBUG   ] Got command RPT from MCS: ref #226056
2018-10-21 16:06:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226056  12 58412 57998389 A  ERRORB”™š'
2018-10-21 16:06:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 16:07:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:07:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:07:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:07:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:07:02 [WARNING ] (13, 1, 'bot')
2018-10-21 16:07:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:07:02 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-10-21 16:07:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 16:07:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 16:07:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 16:08:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:08:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 16:08:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:08:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:08:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:08:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:08:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:08:03 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-10-21 16:08:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 16:08:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 16:08:28 [DEBUG   ] Got command RPT from MCS: ref #226057
2018-10-21 16:08:28 [DEBUG   ] summary = ERROR
2018-10-21 16:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226057  13 58412 58108633 A  ERRORERROR'
2018-10-21 16:08:28 [DEBUG   ] Got command RPT from MCS: ref #226058
2018-10-21 16:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226058  77 58412 58108634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:08:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 16:09:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-10-21 16:09:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:09:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:09:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:09:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:09:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:09:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:09:03 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-21 16:09:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 16:09:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 16:09:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 16:10:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:10:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:10:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:10:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:10:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:10:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:10:03 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-21 16:10:06 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-21 16:10:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:10:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 16:11:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:11:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:11:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:11:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:11:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:11:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:11:03 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-21 16:11:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 16:11:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 16:11:37 [DEBUG   ] Got command RPT from MCS: ref #226080
2018-10-21 16:11:37 [DEBUG   ] summary = ERROR
2018-10-21 16:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226080  13 58412 58297665 A  ERRORERROR'
2018-10-21 16:11:37 [DEBUG   ] Got command RPT from MCS: ref #226081
2018-10-21 16:11:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226081  77 58412 58297869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:11:38 [DEBUG   ] Got command RPT from MCS: ref #226082
2018-10-21 16:11:38 [DEBUG   ] summary = ERROR
2018-10-21 16:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226082  13 58412 58298073 A  ERRORERROR'
2018-10-21 16:11:38 [DEBUG   ] Got command RPT from MCS: ref #226084
2018-10-21 16:11:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226084  77 58412 58298265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:11:38 [DEBUG   ] Got command RPT from MCS: ref #226086
2018-10-21 16:11:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226086  12 58412 58298469 A  ERRORB”™š'
2018-10-21 16:11:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:12:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 16:12:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:12:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:12:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:12:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:12:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:12:03 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-10-21 16:12:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 16:12:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 16:12:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 16:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:13:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 16:13:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:13:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:13:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:13:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:13:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:13:03 [DEBUG   ] Finished updating board flags in 1.845 seconds
2018-10-21 16:13:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 16:13:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 16:13:28 [DEBUG   ] Got command RPT from MCS: ref #226094
2018-10-21 16:13:28 [DEBUG   ] summary = ERROR
2018-10-21 16:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226094  13 58412 58408641 A  ERRORERROR'
2018-10-21 16:13:28 [DEBUG   ] Got command RPT from MCS: ref #226095
2018-10-21 16:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226095  77 58412 58408642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:13:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 16:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 16:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 16:14:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:14:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:14:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:14:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:14:03 [DEBUG   ] Finished updating board flags in 1.739 seconds
2018-10-21 16:14:06 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-21 16:14:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-21 16:14:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 16:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:15:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:15:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:15:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:15:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:15:03 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-21 16:15:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 16:15:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 16:15:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 16:16:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:16:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:16:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:16:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:16:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:16:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:16:03 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-21 16:16:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 16:16:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:16:37 [DEBUG   ] Got command RPT from MCS: ref #226115
2018-10-21 16:16:37 [DEBUG   ] summary = ERROR
2018-10-21 16:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226115  13 58412 58597745 A  ERRORERROR'
2018-10-21 16:16:37 [DEBUG   ] Got command RPT from MCS: ref #226116
2018-10-21 16:16:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226116  77 58412 58597949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:16:38 [DEBUG   ] Got command RPT from MCS: ref #226117
2018-10-21 16:16:38 [DEBUG   ] summary = ERROR
2018-10-21 16:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226117  13 58412 58598153 A  ERRORERROR'
2018-10-21 16:16:38 [DEBUG   ] Got command RPT from MCS: ref #226118
2018-10-21 16:16:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226118  77 58412 58598345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:16:38 [DEBUG   ] Got command RPT from MCS: ref #226119
2018-10-21 16:16:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226119  12 58412 58598549 A  ERRORB—™š'
2018-10-21 16:16:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 16:17:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:17:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:17:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:17:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:17:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:17:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:17:03 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-21 16:17:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 16:17:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 16:17:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:18:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:18:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:18:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:18:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:18:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:18:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:18:03 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-10-21 16:18:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:18:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 16:18:28 [DEBUG   ] Got command RPT from MCS: ref #226124
2018-10-21 16:18:28 [DEBUG   ] summary = ERROR
2018-10-21 16:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226124  13 58412 58708645 A  ERRORERROR'
2018-10-21 16:18:28 [DEBUG   ] Got command RPT from MCS: ref #226125
2018-10-21 16:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226125  77 58412 58708646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:18:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 16:19:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:19:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:19:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:19:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:19:03 [WARNING ] (13, 1, 'bot')
2018-10-21 16:19:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:19:03 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-10-21 16:19:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 16:19:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 16:19:47 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-21 16:20:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 16:20:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 16:20:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:20:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:20:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:20:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:20:04 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-21 16:20:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 16:20:28 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 16:20:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-21 16:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 16:21:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:21:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:21:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:21:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:21:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:21:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:21:04 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-21 16:21:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 16:21:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:21:37 [DEBUG   ] Got command RPT from MCS: ref #226147
2018-10-21 16:21:37 [DEBUG   ] summary = ERROR
2018-10-21 16:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226147  13 58412 58897821 A  ERRORERROR'
2018-10-21 16:21:38 [DEBUG   ] Got command RPT from MCS: ref #226148
2018-10-21 16:21:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226148  77 58412 58898025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:21:38 [DEBUG   ] Got command RPT from MCS: ref #226149
2018-10-21 16:21:38 [DEBUG   ] summary = ERROR
2018-10-21 16:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226149  13 58412 58898229 A  ERRORERROR'
2018-10-21 16:21:38 [DEBUG   ] Got command RPT from MCS: ref #226151
2018-10-21 16:21:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226151  77 58412 58898433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:21:38 [DEBUG   ] Got command RPT from MCS: ref #226152
2018-10-21 16:21:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226152  12 58412 58898625 A  ERRORB–™š'
2018-10-21 16:21:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:22:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:22:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 16:22:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:22:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:22:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:22:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:22:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:22:04 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-21 16:22:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 16:22:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 16:22:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:23:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:23:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:23:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:23:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:23:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:23:04 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-10-21 16:23:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 16:23:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 16:23:28 [DEBUG   ] Got command RPT from MCS: ref #226157
2018-10-21 16:23:28 [DEBUG   ] summary = ERROR
2018-10-21 16:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226157  13 58412 59008645 A  ERRORERROR'
2018-10-21 16:23:28 [DEBUG   ] Got command RPT from MCS: ref #226158
2018-10-21 16:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226158  77 58412 59008646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:23:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 16:24:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:24:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:24:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:24:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:24:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:24:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:24:04 [DEBUG   ] Finished updating board flags in 1.665 seconds
2018-10-21 16:24:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 16:24:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:24:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 16:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:25:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:25:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:25:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:25:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:25:04 [DEBUG   ] Finished updating board flags in 1.535 seconds
2018-10-21 16:25:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 16:25:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:25:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:26:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:26:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:26:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:26:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:26:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:26:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:26:04 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-10-21 16:26:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 16:26:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:26:37 [DEBUG   ] Got command RPT from MCS: ref #226178
2018-10-21 16:26:37 [DEBUG   ] summary = ERROR
2018-10-21 16:26:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226178  13 58412 59197909 A  ERRORERROR'
2018-10-21 16:26:38 [DEBUG   ] Got command RPT from MCS: ref #226179
2018-10-21 16:26:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226179  77 58412 59198101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:26:38 [DEBUG   ] Got command RPT from MCS: ref #226180
2018-10-21 16:26:38 [DEBUG   ] summary = ERROR
2018-10-21 16:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226180  13 58412 59198305 A  ERRORERROR'
2018-10-21 16:26:38 [DEBUG   ] Got command RPT from MCS: ref #226181
2018-10-21 16:26:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226181  77 58412 59198509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:26:38 [DEBUG   ] Got command RPT from MCS: ref #226182
2018-10-21 16:26:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226182  12 58412 59198713 A  ERRORB•™š'
2018-10-21 16:26:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:27:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:27:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:27:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:27:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:27:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:27:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:27:04 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-10-21 16:27:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:27:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 16:27:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 16:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:28:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:28:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:28:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:28:04 [WARNING ] (13, 1, 'bot')
2018-10-21 16:28:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:28:04 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-10-21 16:28:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 16:28:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 16:28:28 [DEBUG   ] Got command RPT from MCS: ref #226187
2018-10-21 16:28:28 [DEBUG   ] summary = ERROR
2018-10-21 16:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226187  13 58412 59308649 A  ERRORERROR'
2018-10-21 16:28:28 [DEBUG   ] Got command RPT from MCS: ref #226188
2018-10-21 16:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226188  77 58412 59308650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:28:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 16:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:29:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:29:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:29:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:29:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:29:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:29:05 [DEBUG   ] Finished updating board flags in 2.225 seconds
2018-10-21 16:29:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 16:29:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 16:29:49 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 16:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:30:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:30:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:30:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:30:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:30:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:30:05 [DEBUG   ] Finished updating board flags in 2.127 seconds
2018-10-21 16:30:09 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-21 16:30:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 16:30:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 16:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:31:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:31:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:31:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:31:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:31:05 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-21 16:31:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 16:31:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 16:31:37 [DEBUG   ] Got command RPT from MCS: ref #226210
2018-10-21 16:31:37 [DEBUG   ] summary = ERROR
2018-10-21 16:31:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226210  13 58412 59497981 A  ERRORERROR'
2018-10-21 16:31:38 [DEBUG   ] Got command RPT from MCS: ref #226211
2018-10-21 16:31:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226211  77 58412 59498185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:31:38 [DEBUG   ] Got command RPT from MCS: ref #226212
2018-10-21 16:31:38 [DEBUG   ] summary = ERROR
2018-10-21 16:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226212  13 58412 59498389 A  ERRORERROR'
2018-10-21 16:31:38 [DEBUG   ] Got command RPT from MCS: ref #226214
2018-10-21 16:31:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226214  77 58412 59498593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:31:38 [DEBUG   ] Got command RPT from MCS: ref #226215
2018-10-21 16:31:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226215  12 58412 59498785 A  ERRORB•™š'
2018-10-21 16:31:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:32:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:32:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:32:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:32:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:32:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:32:05 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-10-21 16:32:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:32:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 16:32:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 16:33:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:33:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:33:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:33:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:33:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:33:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:33:05 [DEBUG   ] Finished updating board flags in 1.882 seconds
2018-10-21 16:33:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 16:33:28 [DEBUG   ] Got command RPT from MCS: ref #226224
2018-10-21 16:33:28 [DEBUG   ] summary = ERROR
2018-10-21 16:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226224  13 58412 59608645 A  ERRORERROR'
2018-10-21 16:33:28 [DEBUG   ] Got command RPT from MCS: ref #226225
2018-10-21 16:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226225  77 58412 59608646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:33:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 16:33:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 16:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:34:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:34:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:34:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:34:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:34:05 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-21 16:34:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 16:34:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 16:34:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 16:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:35:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:35:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:35:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:35:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:35:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:35:05 [DEBUG   ] Finished updating board flags in 1.719 seconds
2018-10-21 16:35:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 16:35:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 16:35:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 16:36:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:36:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:36:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:36:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:36:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:36:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:36:05 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-21 16:36:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-21 16:36:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 16:36:38 [DEBUG   ] Got command RPT from MCS: ref #226245
2018-10-21 16:36:38 [DEBUG   ] summary = ERROR
2018-10-21 16:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226245  13 58412 59798069 A  ERRORERROR'
2018-10-21 16:36:38 [DEBUG   ] Got command RPT from MCS: ref #226246
2018-10-21 16:36:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226246  77 58412 59798261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:36:38 [DEBUG   ] Got command RPT from MCS: ref #226247
2018-10-21 16:36:38 [DEBUG   ] summary = ERROR
2018-10-21 16:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226247  13 58412 59798465 A  ERRORERROR'
2018-10-21 16:36:38 [DEBUG   ] Got command RPT from MCS: ref #226248
2018-10-21 16:36:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226248  77 58412 59798669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:36:38 [DEBUG   ] Got command RPT from MCS: ref #226249
2018-10-21 16:36:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226249  12 58412 59798873 A  ERRORB”™š'
2018-10-21 16:36:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:37:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:37:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:37:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:37:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:37:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:37:05 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-21 16:37:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 16:37:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 16:37:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 16:38:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:38:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 16:38:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:38:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:38:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:38:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:38:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:38:05 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-21 16:38:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:38:28 [DEBUG   ] Got command RPT from MCS: ref #226250
2018-10-21 16:38:28 [DEBUG   ] summary = ERROR
2018-10-21 16:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226250  13 58412 59908655 A  ERRORERROR'
2018-10-21 16:38:28 [DEBUG   ] Got command RPT from MCS: ref #226251
2018-10-21 16:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226251  77 58412 59908655 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:38:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 16:38:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 16:39:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:39:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:39:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:39:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:39:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:39:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:39:05 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-21 16:39:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 16:39:31 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2018-10-21 16:39:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 16:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:40:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:40:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:40:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:40:05 [WARNING ] (13, 1, 'bot')
2018-10-21 16:40:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:40:05 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-21 16:40:11 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-21 16:40:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 16:40:51 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-21 16:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:41:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:41:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:41:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:41:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:41:06 [DEBUG   ] Finished updating board flags in 2.050 seconds
2018-10-21 16:41:10 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 16:41:31 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-10-21 16:41:38 [DEBUG   ] Got command RPT from MCS: ref #226273
2018-10-21 16:41:38 [DEBUG   ] summary = ERROR
2018-10-21 16:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226273  13 58412 60098145 A  ERRORERROR'
2018-10-21 16:41:38 [DEBUG   ] Got command RPT from MCS: ref #226274
2018-10-21 16:41:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226274  77 58412 60098349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:41:38 [DEBUG   ] Got command RPT from MCS: ref #226275
2018-10-21 16:41:38 [DEBUG   ] summary = ERROR
2018-10-21 16:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226275  13 58412 60098541 A  ERRORERROR'
2018-10-21 16:41:38 [DEBUG   ] Got command RPT from MCS: ref #226277
2018-10-21 16:41:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226277  77 58412 60098745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:41:38 [DEBUG   ] Got command RPT from MCS: ref #226278
2018-10-21 16:41:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:41:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226278  12 58412 60098949 A  ERRORB”™š'
2018-10-21 16:41:51 [DEBUG   ] Finished updating ant stats in 1.211 seconds
2018-10-21 16:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:42:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:42:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:42:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:42:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:42:06 [DEBUG   ] Finished updating board flags in 2.116 seconds
2018-10-21 16:42:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 16:42:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 16:42:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 16:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:43:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:43:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:43:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:43:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:43:06 [DEBUG   ] Finished updating board flags in 1.884 seconds
2018-10-21 16:43:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 16:43:28 [DEBUG   ] Got command RPT from MCS: ref #226287
2018-10-21 16:43:28 [DEBUG   ] summary = ERROR
2018-10-21 16:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226287  13 58412 60208645 A  ERRORERROR'
2018-10-21 16:43:28 [DEBUG   ] Got command RPT from MCS: ref #226288
2018-10-21 16:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226288  77 58412 60208646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:43:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 16:43:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 16:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:44:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:44:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:44:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:44:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:44:06 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-21 16:44:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:44:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:44:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 16:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:45:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:45:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:45:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:45:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:45:06 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-21 16:45:11 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-21 16:45:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:45:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:46:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:46:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:46:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:46:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:46:06 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-21 16:46:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 16:46:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 16:46:38 [DEBUG   ] Got command RPT from MCS: ref #226308
2018-10-21 16:46:38 [DEBUG   ] summary = ERROR
2018-10-21 16:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226308  13 58412 60398221 A  ERRORERROR'
2018-10-21 16:46:38 [DEBUG   ] Got command RPT from MCS: ref #226309
2018-10-21 16:46:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226309  77 58412 60398425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:46:38 [DEBUG   ] Got command RPT from MCS: ref #226310
2018-10-21 16:46:38 [DEBUG   ] summary = ERROR
2018-10-21 16:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226310  13 58412 60398629 A  ERRORERROR'
2018-10-21 16:46:38 [DEBUG   ] Got command RPT from MCS: ref #226311
2018-10-21 16:46:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:46:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226311  77 58412 60398821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:46:39 [DEBUG   ] Got command RPT from MCS: ref #226312
2018-10-21 16:46:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226312  12 58412 60399025 A  ERRORB”™š'
2018-10-21 16:46:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 16:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:47:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:47:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:47:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:47:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:47:06 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-10-21 16:47:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 16:47:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 16:47:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 16:48:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:48:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:48:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:48:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:48:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:48:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:48:06 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-21 16:48:12 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-21 16:48:28 [DEBUG   ] Got command RPT from MCS: ref #226317
2018-10-21 16:48:28 [DEBUG   ] summary = ERROR
2018-10-21 16:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226317  13 58412 60508641 A  ERRORERROR'
2018-10-21 16:48:28 [DEBUG   ] Got command RPT from MCS: ref #226318
2018-10-21 16:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226318  77 58412 60508642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:48:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-21 16:48:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 16:49:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:49:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:49:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:49:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:49:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:49:06 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-10-21 16:49:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:49:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:49:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 16:50:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:50:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:50:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:50:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:50:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:50:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:50:06 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-10-21 16:50:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 16:50:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:50:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 16:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:51:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:51:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:51:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:51:06 [WARNING ] (13, 1, 'bot')
2018-10-21 16:51:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:51:06 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-21 16:51:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 16:51:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 16:51:38 [DEBUG   ] Got command RPT from MCS: ref #226340
2018-10-21 16:51:38 [DEBUG   ] summary = ERROR
2018-10-21 16:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226340  13 58412 60698301 A  ERRORERROR'
2018-10-21 16:51:38 [DEBUG   ] Got command RPT from MCS: ref #226341
2018-10-21 16:51:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226341  77 58412 60698505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:51:38 [DEBUG   ] Got command RPT from MCS: ref #226342
2018-10-21 16:51:38 [DEBUG   ] summary = ERROR
2018-10-21 16:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226342  13 58412 60698709 A  ERRORERROR'
2018-10-21 16:51:38 [DEBUG   ] Got command RPT from MCS: ref #226344
2018-10-21 16:51:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226344  77 58412 60698901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:51:39 [DEBUG   ] Got command RPT from MCS: ref #226345
2018-10-21 16:51:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226345  12 58412 60699105 A  ERRORB”™š'
2018-10-21 16:51:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:52:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:52:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:52:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:52:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:52:07 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-10-21 16:52:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:52:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 16:52:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 16:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:53:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:53:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:53:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:53:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:53:07 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-10-21 16:53:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:53:28 [DEBUG   ] Got command RPT from MCS: ref #226350
2018-10-21 16:53:28 [DEBUG   ] summary = ERROR
2018-10-21 16:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226350  13 58412 60808660 A  ERRORERROR'
2018-10-21 16:53:28 [DEBUG   ] Got command RPT from MCS: ref #226351
2018-10-21 16:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226351  77 58412 60808661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:53:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 16:53:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 16:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:54:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 16:54:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:54:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:54:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:54:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:54:07 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-10-21 16:54:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 16:54:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 16:54:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 16:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:55:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:55:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:55:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:55:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:55:07 [DEBUG   ] Finished updating board flags in 1.915 seconds
2018-10-21 16:55:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 16:55:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 16:55:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 16:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:56:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:56:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:56:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:56:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:56:07 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-10-21 16:56:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 16:56:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 16:56:38 [DEBUG   ] Got command RPT from MCS: ref #226371
2018-10-21 16:56:38 [DEBUG   ] summary = ERROR
2018-10-21 16:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226371  13 58412 60998381 A  ERRORERROR'
2018-10-21 16:56:38 [DEBUG   ] Got command RPT from MCS: ref #226372
2018-10-21 16:56:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226372  77 58412 60998585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:56:38 [DEBUG   ] Got command RPT from MCS: ref #226373
2018-10-21 16:56:38 [DEBUG   ] summary = ERROR
2018-10-21 16:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226373  13 58412 60998777 A  ERRORERROR'
2018-10-21 16:56:38 [DEBUG   ] Got command RPT from MCS: ref #226374
2018-10-21 16:56:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:56:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226374  77 58412 60998981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:56:39 [DEBUG   ] Got command RPT from MCS: ref #226375
2018-10-21 16:56:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 16:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226375  12 58412 60999185 A  ERRORB”™š'
2018-10-21 16:56:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 16:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:57:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:57:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:57:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:57:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:57:07 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-21 16:57:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 16:57:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 16:57:53 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 16:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:58:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:58:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:58:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:58:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:58:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:58:07 [DEBUG   ] Finished updating board flags in 1.761 seconds
2018-10-21 16:58:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 16:58:28 [DEBUG   ] Got command RPT from MCS: ref #226380
2018-10-21 16:58:28 [DEBUG   ] summary = ERROR
2018-10-21 16:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226380  13 58412 61108650 A  ERRORERROR'
2018-10-21 16:58:28 [DEBUG   ] Got command RPT from MCS: ref #226381
2018-10-21 16:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 16:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226381  77 58412 61108650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 16:58:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 16:58:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 16:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 16:59:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:59:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:59:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:59:07 [WARNING ] (13, 1, 'bot')
2018-10-21 16:59:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 16:59:07 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-21 16:59:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 16:59:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 16:59:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:00:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:00:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:00:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:00:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:00:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:00:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:00:07 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-10-21 17:00:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 17:00:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 17:00:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:01:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:01:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:01:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:01:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:01:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:01:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:01:07 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-21 17:01:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:01:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 17:01:38 [DEBUG   ] Got command RPT from MCS: ref #226403
2018-10-21 17:01:38 [DEBUG   ] summary = ERROR
2018-10-21 17:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226403  13 58412 61298457 A  ERRORERROR'
2018-10-21 17:01:38 [DEBUG   ] Got command RPT from MCS: ref #226404
2018-10-21 17:01:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226404  77 58412 61298661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:01:38 [DEBUG   ] Got command RPT from MCS: ref #226405
2018-10-21 17:01:38 [DEBUG   ] summary = ERROR
2018-10-21 17:01:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226405  13 58412 61298865 A  ERRORERROR'
2018-10-21 17:01:39 [DEBUG   ] Got command RPT from MCS: ref #226407
2018-10-21 17:01:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226407  77 58412 61299057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:01:39 [DEBUG   ] Got command RPT from MCS: ref #226409
2018-10-21 17:01:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226409  12 58412 61299261 A  ERRORB”™š'
2018-10-21 17:01:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 17:02:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:02:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:02:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:02:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:02:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:02:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:02:07 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-10-21 17:02:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:02:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:02:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 17:03:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:03:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 17:03:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:03:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:03:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:03:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:03:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:03:07 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-10-21 17:03:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 17:03:28 [DEBUG   ] Got command RPT from MCS: ref #226417
2018-10-21 17:03:28 [DEBUG   ] summary = ERROR
2018-10-21 17:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226417  13 58412 61408649 A  ERRORERROR'
2018-10-21 17:03:28 [DEBUG   ] Got command RPT from MCS: ref #226418
2018-10-21 17:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226418  77 58412 61408650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:03:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:03:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:04:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:04:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:04:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:04:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:04:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:04:07 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-10-21 17:04:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 17:04:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:04:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:05:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:05:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:05:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:05:07 [WARNING ] (13, 1, 'bot')
2018-10-21 17:05:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:05:07 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-10-21 17:05:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:05:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 17:05:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:06:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:06:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:06:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:06:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:06:08 [DEBUG   ] Finished updating board flags in 2.272 seconds
2018-10-21 17:06:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:06:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:06:38 [DEBUG   ] Got command RPT from MCS: ref #226438
2018-10-21 17:06:38 [DEBUG   ] summary = ERROR
2018-10-21 17:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226438  13 58412 61598537 A  ERRORERROR'
2018-10-21 17:06:38 [DEBUG   ] Got command RPT from MCS: ref #226439
2018-10-21 17:06:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226439  77 58412 61598741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:06:38 [DEBUG   ] Got command RPT from MCS: ref #226440
2018-10-21 17:06:38 [DEBUG   ] summary = ERROR
2018-10-21 17:06:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226440  13 58412 61598945 A  ERRORERROR'
2018-10-21 17:06:39 [DEBUG   ] Got command RPT from MCS: ref #226441
2018-10-21 17:06:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226441  77 58412 61599137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:06:39 [DEBUG   ] Got command RPT from MCS: ref #226442
2018-10-21 17:06:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226442  12 58412 61599341 A  ERRORB”™š'
2018-10-21 17:06:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 17:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:07:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:07:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:07:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:07:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:07:08 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-10-21 17:07:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 17:07:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 17:07:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 17:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:08:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:08:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:08:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:08:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:08:08 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-21 17:08:14 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 17:08:28 [DEBUG   ] Got command RPT from MCS: ref #226443
2018-10-21 17:08:28 [DEBUG   ] summary = ERROR
2018-10-21 17:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226443  13 58412 61708649 A  ERRORERROR'
2018-10-21 17:08:28 [DEBUG   ] Got command RPT from MCS: ref #226444
2018-10-21 17:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226444  77 58412 61708650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:08:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 17:08:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 17:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:09:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:09:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:09:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:09:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:09:08 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-10-21 17:09:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:09:34 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-21 17:09:54 [DEBUG   ] Finished updating ant stats in 0.826 seconds
2018-10-21 17:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:10:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:10:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:10:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:10:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:10:08 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-10-21 17:10:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 17:10:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 17:10:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 17:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:11:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:11:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:11:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:11:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:11:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:11:08 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-10-21 17:11:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:11:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:11:38 [DEBUG   ] Got command RPT from MCS: ref #226466
2018-10-21 17:11:38 [DEBUG   ] summary = ERROR
2018-10-21 17:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226466  13 58412 61898613 A  ERRORERROR'
2018-10-21 17:11:38 [DEBUG   ] Got command RPT from MCS: ref #226467
2018-10-21 17:11:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:11:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226467  77 58412 61898817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:11:39 [DEBUG   ] Got command RPT from MCS: ref #226468
2018-10-21 17:11:39 [DEBUG   ] summary = ERROR
2018-10-21 17:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226468  13 58412 61899021 A  ERRORERROR'
2018-10-21 17:11:39 [DEBUG   ] Got command RPT from MCS: ref #226470
2018-10-21 17:11:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226470  77 58412 61899225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:11:39 [DEBUG   ] Got command RPT from MCS: ref #226471
2018-10-21 17:11:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226471  12 58412 61899417 A  ERRORB”™š'
2018-10-21 17:11:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 17:12:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:12:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:12:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:12:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:12:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:12:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:12:08 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-21 17:12:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 17:12:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:12:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:13:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:13:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:13:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:13:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:13:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:13:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:13:08 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-21 17:13:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 17:13:28 [DEBUG   ] Got command RPT from MCS: ref #226480
2018-10-21 17:13:28 [DEBUG   ] summary = ERROR
2018-10-21 17:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226480  13 58412 62008664 A  ERRORERROR'
2018-10-21 17:13:28 [DEBUG   ] Got command RPT from MCS: ref #226481
2018-10-21 17:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226481  77 58412 62008664 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:13:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 17:13:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:14:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:14:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:14:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:14:08 [WARNING ] (13, 1, 'bot')
2018-10-21 17:14:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:14:08 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-10-21 17:14:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 17:14:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 17:14:54 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-21 17:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:15:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 17:15:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:15:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:15:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:15:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:15:09 [DEBUG   ] Finished updating board flags in 2.088 seconds
2018-10-21 17:15:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 17:15:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 17:15:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 17:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:16:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:16:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:16:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:16:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:16:09 [DEBUG   ] Finished updating board flags in 1.952 seconds
2018-10-21 17:16:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 17:16:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:16:38 [DEBUG   ] Got command RPT from MCS: ref #226501
2018-10-21 17:16:38 [DEBUG   ] summary = ERROR
2018-10-21 17:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226501  13 58412 62198697 A  ERRORERROR'
2018-10-21 17:16:38 [DEBUG   ] Got command RPT from MCS: ref #226502
2018-10-21 17:16:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:16:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226502  77 58412 62198901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:16:39 [DEBUG   ] Got command RPT from MCS: ref #226503
2018-10-21 17:16:39 [DEBUG   ] summary = ERROR
2018-10-21 17:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226503  13 58412 62199105 A  ERRORERROR'
2018-10-21 17:16:39 [DEBUG   ] Got command RPT from MCS: ref #226504
2018-10-21 17:16:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226504  77 58412 62199297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:16:39 [DEBUG   ] Got command RPT from MCS: ref #226505
2018-10-21 17:16:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226505  12 58412 62199501 A  ERRORB”™š'
2018-10-21 17:16:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 17:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:17:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:17:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:17:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:17:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:17:09 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-21 17:17:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:17:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:17:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:18:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 17:18:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:18:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:18:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:18:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:18:09 [DEBUG   ] Finished updating board flags in 1.884 seconds
2018-10-21 17:18:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 17:18:28 [DEBUG   ] Got command RPT from MCS: ref #226510
2018-10-21 17:18:28 [DEBUG   ] summary = ERROR
2018-10-21 17:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226510  13 58412 62308667 A  ERRORERROR'
2018-10-21 17:18:28 [DEBUG   ] Got command RPT from MCS: ref #226511
2018-10-21 17:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226511  77 58412 62308667 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:18:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:18:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:19:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:19:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:19:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:19:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:19:09 [DEBUG   ] Finished updating board flags in 1.717 seconds
2018-10-21 17:19:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 17:19:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 17:19:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 17:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:20:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 17:20:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:20:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:20:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:20:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:20:09 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-21 17:20:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:20:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 17:20:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 17:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:21:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:21:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:21:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:21:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:21:09 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-21 17:21:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 17:21:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 17:21:38 [DEBUG   ] Got command RPT from MCS: ref #226533
2018-10-21 17:21:38 [DEBUG   ] summary = ERROR
2018-10-21 17:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226533  13 58412 62498777 A  ERRORERROR'
2018-10-21 17:21:38 [DEBUG   ] Got command RPT from MCS: ref #226534
2018-10-21 17:21:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:21:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226534  77 58412 62498981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:21:39 [DEBUG   ] Got command RPT from MCS: ref #226535
2018-10-21 17:21:39 [DEBUG   ] summary = ERROR
2018-10-21 17:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226535  13 58412 62499173 A  ERRORERROR'
2018-10-21 17:21:39 [DEBUG   ] Got command RPT from MCS: ref #226537
2018-10-21 17:21:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226537  77 58412 62499377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:21:39 [DEBUG   ] Got command RPT from MCS: ref #226538
2018-10-21 17:21:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226538  12 58412 62499581 A  ERRORB•™š'
2018-10-21 17:21:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 17:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:22:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:22:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:22:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:22:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:22:09 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-21 17:22:16 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-21 17:22:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 17:22:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:23:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:23:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 17:23:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:23:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:23:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:23:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:23:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:23:09 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-10-21 17:23:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:23:28 [DEBUG   ] Got command RPT from MCS: ref #226543
2018-10-21 17:23:28 [DEBUG   ] summary = ERROR
2018-10-21 17:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226543  13 58412 62608665 A  ERRORERROR'
2018-10-21 17:23:28 [DEBUG   ] Got command RPT from MCS: ref #226544
2018-10-21 17:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226544  77 58412 62608666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:23:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:23:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:24:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:24:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:24:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:24:09 [WARNING ] (13, 1, 'bot')
2018-10-21 17:24:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:24:09 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-10-21 17:24:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:24:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:24:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:25:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:25:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:25:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:25:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:25:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:25:10 [DEBUG   ] Finished updating board flags in 2.066 seconds
2018-10-21 17:25:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 17:25:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 17:25:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:26:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:26:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:26:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:26:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:26:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:26:10 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-10-21 17:26:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:26:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:26:38 [DEBUG   ] Got command RPT from MCS: ref #226564
2018-10-21 17:26:38 [DEBUG   ] summary = ERROR
2018-10-21 17:26:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226564  13 58412 62798857 A  ERRORERROR'
2018-10-21 17:26:39 [DEBUG   ] Got command RPT from MCS: ref #226565
2018-10-21 17:26:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226565  77 58412 62799061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:26:39 [DEBUG   ] Got command RPT from MCS: ref #226566
2018-10-21 17:26:39 [DEBUG   ] summary = ERROR
2018-10-21 17:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226566  13 58412 62799253 A  ERRORERROR'
2018-10-21 17:26:39 [DEBUG   ] Got command RPT from MCS: ref #226567
2018-10-21 17:26:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226567  77 58412 62799457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:26:39 [DEBUG   ] Got command RPT from MCS: ref #226568
2018-10-21 17:26:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226568  12 58412 62799661 A  ERRORB•™š'
2018-10-21 17:26:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:27:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:27:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:27:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:27:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:27:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:27:10 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-21 17:27:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 17:27:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:27:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:28:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 17:28:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:28:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:28:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:28:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:28:10 [DEBUG   ] Finished updating board flags in 1.770 seconds
2018-10-21 17:28:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 17:28:28 [DEBUG   ] Got command RPT from MCS: ref #226573
2018-10-21 17:28:28 [DEBUG   ] summary = ERROR
2018-10-21 17:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226573  13 58412 62908658 A  ERRORERROR'
2018-10-21 17:28:28 [DEBUG   ] Got command RPT from MCS: ref #226574
2018-10-21 17:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226574  77 58412 62908659 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:28:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 17:28:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:29:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:29:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:29:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:29:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:29:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:29:10 [DEBUG   ] Finished updating board flags in 1.716 seconds
2018-10-21 17:29:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 17:29:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 17:29:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 17:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:30:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 17:30:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:30:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:30:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:30:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:30:10 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-10-21 17:30:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:30:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:30:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 17:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:31:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:31:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:31:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:31:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:31:10 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-10-21 17:31:16 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-21 17:31:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:31:38 [DEBUG   ] Got command RPT from MCS: ref #226596
2018-10-21 17:31:38 [DEBUG   ] summary = ERROR
2018-10-21 17:31:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226596  13 58412 63098941 A  ERRORERROR'
2018-10-21 17:31:39 [DEBUG   ] Got command RPT from MCS: ref #226597
2018-10-21 17:31:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226597  77 58412 63099133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:31:39 [DEBUG   ] Got command RPT from MCS: ref #226598
2018-10-21 17:31:39 [DEBUG   ] summary = ERROR
2018-10-21 17:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226598  13 58412 63099337 A  ERRORERROR'
2018-10-21 17:31:39 [DEBUG   ] Got command RPT from MCS: ref #226600
2018-10-21 17:31:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226600  77 58412 63099541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:31:39 [DEBUG   ] Got command RPT from MCS: ref #226601
2018-10-21 17:31:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226601  12 58412 63099745 A  ERRORB–™š'
2018-10-21 17:31:56 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 17:32:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:32:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:32:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:32:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:32:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:32:10 [DEBUG   ] Finished updating board flags in 1.457 seconds
2018-10-21 17:32:17 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 17:32:37 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 17:32:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:33:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:33:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:33:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:33:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:33:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:33:10 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-10-21 17:33:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 17:33:28 [DEBUG   ] Got command RPT from MCS: ref #226610
2018-10-21 17:33:28 [DEBUG   ] summary = ERROR
2018-10-21 17:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226610  13 58412 63208664 A  ERRORERROR'
2018-10-21 17:33:28 [DEBUG   ] Got command RPT from MCS: ref #226611
2018-10-21 17:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226611  77 58412 63208664 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:33:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 17:33:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 17:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:34:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 17:34:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:34:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:34:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:34:10 [WARNING ] (13, 1, 'bot')
2018-10-21 17:34:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:34:10 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-10-21 17:34:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 17:34:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:34:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 17:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:35:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:35:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:35:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:35:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:35:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:35:11 [DEBUG   ] Finished updating board flags in 2.185 seconds
2018-10-21 17:35:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:35:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:35:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:36:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 17:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:36:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 17:36:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:36:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:36:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:36:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:36:11 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-10-21 17:36:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 17:36:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:36:39 [DEBUG   ] Got command RPT from MCS: ref #226631
2018-10-21 17:36:39 [DEBUG   ] summary = ERROR
2018-10-21 17:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226631  13 58412 63399013 A  ERRORERROR'
2018-10-21 17:36:39 [DEBUG   ] Got command RPT from MCS: ref #226632
2018-10-21 17:36:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226632  77 58412 63399217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:36:39 [DEBUG   ] Got command RPT from MCS: ref #226633
2018-10-21 17:36:39 [DEBUG   ] summary = ERROR
2018-10-21 17:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226633  13 58412 63399421 A  ERRORERROR'
2018-10-21 17:36:39 [DEBUG   ] Got command RPT from MCS: ref #226634
2018-10-21 17:36:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226634  77 58412 63399625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:36:39 [DEBUG   ] Got command RPT from MCS: ref #226635
2018-10-21 17:36:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226635  12 58412 63399817 A  ERRORB–™š'
2018-10-21 17:36:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 17:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:37:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:37:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:37:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:37:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:37:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:37:11 [DEBUG   ] Finished updating board flags in 1.959 seconds
2018-10-21 17:37:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 17:37:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 17:37:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:38:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 17:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:38:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:38:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:38:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:38:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:38:11 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-21 17:38:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:38:28 [DEBUG   ] Got command RPT from MCS: ref #226636
2018-10-21 17:38:28 [DEBUG   ] summary = ERROR
2018-10-21 17:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226636  13 58412 63508661 A  ERRORERROR'
2018-10-21 17:38:28 [DEBUG   ] Got command RPT from MCS: ref #226637
2018-10-21 17:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226637  77 58412 63508662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:38:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 17:38:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 17:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:39:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:39:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:39:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:39:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:39:11 [DEBUG   ] Finished updating board flags in 1.841 seconds
2018-10-21 17:39:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:39:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:39:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 17:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:40:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:40:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:40:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:40:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:40:11 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-21 17:40:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 17:40:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:40:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:41:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-21 17:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:41:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:41:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:41:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:41:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:41:11 [DEBUG   ] Finished updating board flags in 1.726 seconds
2018-10-21 17:41:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:41:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:41:39 [DEBUG   ] Got command RPT from MCS: ref #226659
2018-10-21 17:41:39 [DEBUG   ] summary = ERROR
2018-10-21 17:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226659  13 58412 63699101 A  ERRORERROR'
2018-10-21 17:41:39 [DEBUG   ] Got command RPT from MCS: ref #226660
2018-10-21 17:41:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226660  77 58412 63699293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:41:39 [DEBUG   ] Got command RPT from MCS: ref #226661
2018-10-21 17:41:39 [DEBUG   ] summary = ERROR
2018-10-21 17:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226661  13 58412 63699497 A  ERRORERROR'
2018-10-21 17:41:39 [DEBUG   ] Got command RPT from MCS: ref #226663
2018-10-21 17:41:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226663  77 58412 63699701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:41:39 [DEBUG   ] Got command RPT from MCS: ref #226665
2018-10-21 17:41:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:41:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226665  12 58412 63699905 A  ERRORB–™š'
2018-10-21 17:41:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:42:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:42:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:42:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:42:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:42:11 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-10-21 17:42:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 17:42:38 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-21 17:42:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 17:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:43:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:43:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:43:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:43:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:43:11 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-21 17:43:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:43:28 [DEBUG   ] Got command RPT from MCS: ref #226673
2018-10-21 17:43:28 [DEBUG   ] summary = ERROR
2018-10-21 17:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226673  13 58412 63808653 A  ERRORERROR'
2018-10-21 17:43:28 [DEBUG   ] Got command RPT from MCS: ref #226674
2018-10-21 17:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226674  77 58412 63808654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:43:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:43:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:44:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-21 17:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:44:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:44:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:44:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:44:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:44:11 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-21 17:44:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:44:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 17:44:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 17:45:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 17:45:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:45:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:45:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:45:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:45:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:45:11 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-10-21 17:45:11 [DEBUG   ] Got command TBW from MCS: ref #226695
2018-10-21 17:45:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-21 17:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   226695   8 58412 63911877 A  ERROR'
2018-10-21 17:45:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-21 17:45:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-21 17:45:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-21 17:45:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-21 17:45:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-21 17:45:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-21 17:45:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-21 17:45:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-21 17:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-21 17:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-21 17:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-21 17:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-21 17:45:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-21 17:45:15 [DEBUG   ] spawn_process: at 2018-10-21 17:45:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-21 17:45:15 [INFO    ] Finished spawning TBW
2018-10-21 17:46:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 17:46:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:46:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:46:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:46:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:46:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:46:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:46:11 [DEBUG   ] Finished updating board flags in 1.281 seconds
2018-10-21 17:46:39 [DEBUG   ] Got command RPT from MCS: ref #226699
2018-10-21 17:46:39 [DEBUG   ] summary = ERROR
2018-10-21 17:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226699  13 58412 63999173 A  ERRORERROR'
2018-10-21 17:46:39 [DEBUG   ] Got command RPT from MCS: ref #226700
2018-10-21 17:46:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226700  77 58412 63999377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:46:39 [DEBUG   ] Got command RPT from MCS: ref #226701
2018-10-21 17:46:39 [DEBUG   ] summary = ERROR
2018-10-21 17:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226701  13 58412 63999581 A  ERRORERROR'
2018-10-21 17:46:39 [DEBUG   ] Got command RPT from MCS: ref #226702
2018-10-21 17:46:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226702  77 58412 63999785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:46:39 [DEBUG   ] Got command RPT from MCS: ref #226703
2018-10-21 17:46:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:46:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226703  12 58412 63999977 A  ERRORB–™š'
2018-10-21 17:47:03 [INFO    ] __waitForTBW - TBW finished in 108.421 s
2018-10-21 17:47:04 [DEBUG   ] Finished updating ant stats in 0.465 seconds
2018-10-21 17:47:04 [INFO    ] Started antennas statistics background thread
2018-10-21 17:47:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540144026']
2018-10-21 17:47:04 [DEBUG   ] spawn_process: at 2018-10-21 17:47:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540144026']
2018-10-21 17:47:04 [INFO    ] Finished spawning TBN in 0.050 s
2018-10-21 17:47:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:47:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:47:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:47:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:47:11 [WARNING ] (13, 1, 'bot')
2018-10-21 17:47:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:47:11 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-10-21 17:47:24 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2018-10-21 17:47:44 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-21 17:48:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 17:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:48:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-21 17:48:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:48:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:48:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:48:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:48:12 [DEBUG   ] Finished updating board flags in 2.203 seconds
2018-10-21 17:48:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 17:48:28 [DEBUG   ] Got command RPT from MCS: ref #226712
2018-10-21 17:48:28 [DEBUG   ] summary = ERROR
2018-10-21 17:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226712  13 58412 64108653 A  ERRORERROR'
2018-10-21 17:48:28 [DEBUG   ] Got command RPT from MCS: ref #226713
2018-10-21 17:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226713  77 58412 64108654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:48:45 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 17:49:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 17:49:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 17:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:49:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 17:49:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:49:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:49:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:49:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:49:12 [DEBUG   ] Finished updating board flags in 2.135 seconds
2018-10-21 17:49:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 17:49:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:50:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:50:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 17:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:50:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:50:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:50:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:50:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:50:12 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-10-21 17:50:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 17:50:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:51:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:51:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 17:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:51:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:51:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:51:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:51:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:51:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:51:12 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-10-21 17:51:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:51:39 [DEBUG   ] Got command RPT from MCS: ref #226735
2018-10-21 17:51:39 [DEBUG   ] summary = ERROR
2018-10-21 17:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226735  13 58412 64299261 A  ERRORERROR'
2018-10-21 17:51:39 [DEBUG   ] Got command RPT from MCS: ref #226736
2018-10-21 17:51:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226736  77 58412 64299453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:51:39 [DEBUG   ] Got command RPT from MCS: ref #226737
2018-10-21 17:51:39 [DEBUG   ] summary = ERROR
2018-10-21 17:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226737  13 58412 64299657 A  ERRORERROR'
2018-10-21 17:51:39 [DEBUG   ] Got command RPT from MCS: ref #226739
2018-10-21 17:51:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:51:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226739  77 58412 64299861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:51:40 [DEBUG   ] Got command RPT from MCS: ref #226740
2018-10-21 17:51:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226740  12 58412 64300065 A  ERRORB—™š'
2018-10-21 17:51:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 17:52:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 17:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:52:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:52:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:52:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:52:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:52:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:52:12 [DEBUG   ] Finished updating board flags in 1.940 seconds
2018-10-21 17:52:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 17:52:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 17:53:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 17:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:53:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:53:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:53:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:53:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:53:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:53:12 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-21 17:53:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:53:28 [DEBUG   ] Got command RPT from MCS: ref #226745
2018-10-21 17:53:28 [DEBUG   ] summary = ERROR
2018-10-21 17:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226745  13 58412 64408657 A  ERRORERROR'
2018-10-21 17:53:28 [DEBUG   ] Got command RPT from MCS: ref #226746
2018-10-21 17:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226746  77 58412 64408658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:53:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:54:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:54:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 17:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:54:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:54:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:54:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:54:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:54:12 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-21 17:54:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:54:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:55:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:55:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 17:55:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:55:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:55:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:55:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:55:12 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-21 17:55:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:55:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:56:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:56:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:56:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:56:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:56:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:56:12 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-21 17:56:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 17:56:39 [DEBUG   ] Got command RPT from MCS: ref #226766
2018-10-21 17:56:39 [DEBUG   ] summary = ERROR
2018-10-21 17:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226766  13 58412 64599337 A  ERRORERROR'
2018-10-21 17:56:39 [DEBUG   ] Got command RPT from MCS: ref #226767
2018-10-21 17:56:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226767  77 58412 64599541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:56:39 [DEBUG   ] Got command RPT from MCS: ref #226768
2018-10-21 17:56:39 [DEBUG   ] summary = ERROR
2018-10-21 17:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226768  13 58412 64599733 A  ERRORERROR'
2018-10-21 17:56:39 [DEBUG   ] Got command RPT from MCS: ref #226769
2018-10-21 17:56:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:56:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226769  77 58412 64599937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:56:40 [DEBUG   ] Got command RPT from MCS: ref #226770
2018-10-21 17:56:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 17:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226770  12 58412 64600141 A  ERRORB—™š'
2018-10-21 17:56:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 17:57:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 17:57:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 17:57:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:57:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:57:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:57:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:57:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:57:12 [DEBUG   ] Finished updating board flags in 1.857 seconds
2018-10-21 17:57:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 17:57:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 17:58:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 17:58:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:58:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:58:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:58:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:58:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:58:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:58:12 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-21 17:58:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 17:58:28 [DEBUG   ] Got command RPT from MCS: ref #226775
2018-10-21 17:58:28 [DEBUG   ] summary = ERROR
2018-10-21 17:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226775  13 58412 64708657 A  ERRORERROR'
2018-10-21 17:58:28 [DEBUG   ] Got command RPT from MCS: ref #226776
2018-10-21 17:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 17:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226776  77 58412 64708658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 17:58:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 17:59:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 17:59:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 17:59:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:59:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:59:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:59:12 [WARNING ] (13, 1, 'bot')
2018-10-21 17:59:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 17:59:12 [DEBUG   ] Finished updating board flags in 1.675 seconds
2018-10-21 17:59:26 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-21 17:59:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 18:00:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 18:00:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:00:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:00:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:00:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:00:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:00:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:00:12 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-21 18:00:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 18:00:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 18:01:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 18:01:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:01:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:01:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:01:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:01:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:01:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:01:12 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-21 18:01:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 18:01:39 [DEBUG   ] Got command RPT from MCS: ref #226798
2018-10-21 18:01:39 [DEBUG   ] summary = ERROR
2018-10-21 18:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226798  13 58412 64899417 A  ERRORERROR'
2018-10-21 18:01:39 [DEBUG   ] Got command RPT from MCS: ref #226799
2018-10-21 18:01:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226799  77 58412 64899621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:01:39 [DEBUG   ] Got command RPT from MCS: ref #226800
2018-10-21 18:01:39 [DEBUG   ] summary = ERROR
2018-10-21 18:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226800  13 58412 64899813 A  ERRORERROR'
2018-10-21 18:01:40 [DEBUG   ] Got command RPT from MCS: ref #226802
2018-10-21 18:01:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226802  77 58412 64900017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:01:40 [DEBUG   ] Got command RPT from MCS: ref #226804
2018-10-21 18:01:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226804  12 58412 64900221 A  ERRORB˜™š'
2018-10-21 18:01:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:02:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:02:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:02:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:02:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:02:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:02:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:02:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:02:12 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-21 18:02:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:02:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:03:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:03:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 18:03:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:03:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:03:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:03:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:03:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:03:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:03:12 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-21 18:03:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:03:28 [DEBUG   ] Got command RPT from MCS: ref #226812
2018-10-21 18:03:28 [DEBUG   ] summary = ERROR
2018-10-21 18:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226812  13 58412 65008665 A  ERRORERROR'
2018-10-21 18:03:28 [DEBUG   ] Got command RPT from MCS: ref #226813
2018-10-21 18:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226813  77 58412 65008666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:03:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:04:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:04:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:04:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:04:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:04:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:04:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:04:12 [DEBUG   ] Finished updating board flags in 1.483 seconds
2018-10-21 18:04:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:04:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:05:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:05:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 18:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:05:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:05:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:05:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:05:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:05:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:05:12 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-21 18:05:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 18:05:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:06:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:06:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:06:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:06:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:06:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:06:12 [WARNING ] (13, 1, 'bot')
2018-10-21 18:06:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:06:12 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-10-21 18:06:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:06:39 [DEBUG   ] Got command RPT from MCS: ref #226833
2018-10-21 18:06:39 [DEBUG   ] summary = ERROR
2018-10-21 18:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226833  13 58412 65199501 A  ERRORERROR'
2018-10-21 18:06:39 [DEBUG   ] Got command RPT from MCS: ref #226834
2018-10-21 18:06:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226834  77 58412 65199693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:06:39 [DEBUG   ] Got command RPT from MCS: ref #226835
2018-10-21 18:06:39 [DEBUG   ] summary = ERROR
2018-10-21 18:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226835  13 58412 65199897 A  ERRORERROR'
2018-10-21 18:06:40 [DEBUG   ] Got command RPT from MCS: ref #226836
2018-10-21 18:06:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226836  77 58412 65200101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:06:40 [DEBUG   ] Got command RPT from MCS: ref #226837
2018-10-21 18:06:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226837  12 58412 65200305 A  ERRORB˜™š'
2018-10-21 18:06:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:07:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 18:07:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:07:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:07:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:07:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:07:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:07:13 [DEBUG   ] Finished updating board flags in 2.232 seconds
2018-10-21 18:07:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 18:07:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 18:08:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 18:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:08:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:08:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:08:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:08:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:08:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:08:13 [DEBUG   ] Finished updating board flags in 2.081 seconds
2018-10-21 18:08:27 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 18:08:28 [DEBUG   ] Got command RPT from MCS: ref #226838
2018-10-21 18:08:28 [DEBUG   ] summary = ERROR
2018-10-21 18:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226838  13 58412 65308661 A  ERRORERROR'
2018-10-21 18:08:28 [DEBUG   ] Got command RPT from MCS: ref #226839
2018-10-21 18:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226839  77 58412 65308662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:08:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 18:09:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 18:09:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:09:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:09:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:09:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:09:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:09:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:09:13 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-10-21 18:09:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 18:09:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 18:10:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 18:10:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:10:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:10:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:10:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:10:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:10:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:10:13 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-10-21 18:10:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 18:10:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 18:11:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 18:11:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:11:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:11:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:11:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:11:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:11:13 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-21 18:11:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 18:11:39 [DEBUG   ] Got command RPT from MCS: ref #226861
2018-10-21 18:11:39 [DEBUG   ] summary = ERROR
2018-10-21 18:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226861  13 58412 65499573 A  ERRORERROR'
2018-10-21 18:11:39 [DEBUG   ] Got command RPT from MCS: ref #226862
2018-10-21 18:11:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226862  77 58412 65499777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:11:39 [DEBUG   ] Got command RPT from MCS: ref #226863
2018-10-21 18:11:39 [DEBUG   ] summary = ERROR
2018-10-21 18:11:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226863  13 58412 65499981 A  ERRORERROR'
2018-10-21 18:11:40 [DEBUG   ] Got command RPT from MCS: ref #226865
2018-10-21 18:11:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226865  77 58412 65500185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:11:40 [DEBUG   ] Got command RPT from MCS: ref #226867
2018-10-21 18:11:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226867  12 58412 65500377 A  ERRORB˜™š'
2018-10-21 18:11:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 18:12:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 18:12:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:12:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:12:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:12:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:12:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:12:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:12:13 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-21 18:12:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 18:12:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 18:13:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 18:13:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 18:13:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:13:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:13:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:13:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:13:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:13:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:13:13 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-21 18:13:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 18:13:28 [DEBUG   ] Got command RPT from MCS: ref #226875
2018-10-21 18:13:28 [DEBUG   ] summary = ERROR
2018-10-21 18:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226875  13 58412 65608657 A  ERRORERROR'
2018-10-21 18:13:28 [DEBUG   ] Got command RPT from MCS: ref #226876
2018-10-21 18:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226876  77 58412 65608658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:13:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 18:14:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 18:14:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 18:14:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:14:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:14:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:14:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:14:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:14:13 [DEBUG   ] Finished updating board flags in 1.902 seconds
2018-10-21 18:14:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 18:14:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:15:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:15:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 18:15:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:15:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:15:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:15:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:15:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:15:13 [DEBUG   ] Finished updating board flags in 1.770 seconds
2018-10-21 18:15:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:15:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:16:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:16:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:16:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:16:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:16:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:16:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:16:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:16:13 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-10-21 18:16:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 18:16:39 [DEBUG   ] Got command RPT from MCS: ref #226896
2018-10-21 18:16:39 [DEBUG   ] summary = ERROR
2018-10-21 18:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226896  13 58412 65799665 A  ERRORERROR'
2018-10-21 18:16:39 [DEBUG   ] Got command RPT from MCS: ref #226897
2018-10-21 18:16:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226897  77 58412 65799857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:16:40 [DEBUG   ] Got command RPT from MCS: ref #226898
2018-10-21 18:16:40 [DEBUG   ] summary = ERROR
2018-10-21 18:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226898  13 58412 65800061 A  ERRORERROR'
2018-10-21 18:16:40 [DEBUG   ] Got command RPT from MCS: ref #226899
2018-10-21 18:16:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226899  77 58412 65800265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:16:40 [DEBUG   ] Got command RPT from MCS: ref #226900
2018-10-21 18:16:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226900  12 58412 65800457 A  ERRORB™™š'
2018-10-21 18:16:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 18:17:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:17:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:17:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:17:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:17:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:17:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:17:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:17:13 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-10-21 18:17:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:17:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:18:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:18:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:18:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:18:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:18:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:18:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:18:13 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-10-21 18:18:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:18:28 [DEBUG   ] Got command RPT from MCS: ref #226905
2018-10-21 18:18:28 [DEBUG   ] summary = ERROR
2018-10-21 18:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226905  13 58412 65908665 A  ERRORERROR'
2018-10-21 18:18:28 [DEBUG   ] Got command RPT from MCS: ref #226906
2018-10-21 18:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226906  77 58412 65908666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:18:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:19:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:19:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:19:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:19:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:19:13 [WARNING ] (13, 1, 'bot')
2018-10-21 18:19:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:19:13 [DEBUG   ] Finished updating board flags in 1.333 seconds
2018-10-21 18:19:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:19:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:20:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:20:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 18:20:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 18:20:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:20:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:20:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:20:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:20:14 [DEBUG   ] Finished updating board flags in 2.091 seconds
2018-10-21 18:20:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:20:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:21:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:21:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 18:21:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:21:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:21:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:21:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:21:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:21:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:21:14 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-10-21 18:21:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:21:39 [DEBUG   ] Got command RPT from MCS: ref #226928
2018-10-21 18:21:39 [DEBUG   ] summary = ERROR
2018-10-21 18:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226928  13 58412 66099741 A  ERRORERROR'
2018-10-21 18:21:39 [DEBUG   ] Got command RPT from MCS: ref #226929
2018-10-21 18:21:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:21:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226929  77 58412 66099945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:21:40 [DEBUG   ] Got command RPT from MCS: ref #226930
2018-10-21 18:21:40 [DEBUG   ] summary = ERROR
2018-10-21 18:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226930  13 58412 66100137 A  ERRORERROR'
2018-10-21 18:21:40 [DEBUG   ] Got command RPT from MCS: ref #226932
2018-10-21 18:21:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226932  77 58412 66100341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:21:40 [DEBUG   ] Got command RPT from MCS: ref #226933
2018-10-21 18:21:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226933  12 58412 66100545 A  ERRORB™™š'
2018-10-21 18:21:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:22:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:22:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 18:22:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:22:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:22:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:22:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:22:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:22:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:22:14 [DEBUG   ] Finished updating board flags in 1.947 seconds
2018-10-21 18:22:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:22:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:23:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:23:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:23:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:23:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:23:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:23:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:23:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:23:14 [DEBUG   ] Finished updating board flags in 1.673 seconds
2018-10-21 18:23:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 18:23:28 [DEBUG   ] Got command RPT from MCS: ref #226938
2018-10-21 18:23:28 [DEBUG   ] summary = ERROR
2018-10-21 18:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226938  13 58412 66208665 A  ERRORERROR'
2018-10-21 18:23:28 [DEBUG   ] Got command RPT from MCS: ref #226939
2018-10-21 18:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226939  77 58412 66208666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:23:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:24:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 18:24:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 18:24:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 18:24:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:24:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:24:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:24:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:24:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:24:14 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-10-21 18:24:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:24:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 18:25:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:25:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:25:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:25:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:25:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:25:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:25:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:25:14 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-21 18:25:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 18:25:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:26:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 18:26:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:26:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:26:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:26:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:26:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:26:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:26:14 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-10-21 18:26:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:26:39 [DEBUG   ] Got command RPT from MCS: ref #226959
2018-10-21 18:26:39 [DEBUG   ] summary = ERROR
2018-10-21 18:26:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226959  13 58412 66399825 A  ERRORERROR'
2018-10-21 18:26:40 [DEBUG   ] Got command RPT from MCS: ref #226960
2018-10-21 18:26:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226960  77 58412 66400017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:26:40 [DEBUG   ] Got command RPT from MCS: ref #226961
2018-10-21 18:26:40 [DEBUG   ] summary = ERROR
2018-10-21 18:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226961  13 58412 66400221 A  ERRORERROR'
2018-10-21 18:26:40 [DEBUG   ] Got command RPT from MCS: ref #226962
2018-10-21 18:26:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226962  77 58412 66400425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:26:40 [DEBUG   ] Got command RPT from MCS: ref #226963
2018-10-21 18:26:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226963  12 58412 66400617 A  ERRORB™™š'
2018-10-21 18:26:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:27:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:27:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 18:27:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:27:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 18:27:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:27:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:27:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:27:14 [WARNING ] (13, 1, 'bot')
2018-10-21 18:27:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:27:14 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-10-21 18:27:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:27:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:28:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:28:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:28:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:28:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:28:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:28:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:28:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:28:15 [DEBUG   ] Finished updating board flags in 2.253 seconds
2018-10-21 18:28:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:28:28 [DEBUG   ] Got command RPT from MCS: ref #226968
2018-10-21 18:28:28 [DEBUG   ] summary = ERROR
2018-10-21 18:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226968  13 58412 66508669 A  ERRORERROR'
2018-10-21 18:28:28 [DEBUG   ] Got command RPT from MCS: ref #226969
2018-10-21 18:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226969  77 58412 66508670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:28:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 18:29:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:29:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 18:29:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 18:29:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:29:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:29:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:29:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:29:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:29:15 [DEBUG   ] Finished updating board flags in 2.079 seconds
2018-10-21 18:29:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:29:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:30:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:30:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:30:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:30:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:30:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:30:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:30:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:30:15 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-10-21 18:30:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:30:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:31:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:31:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:31:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:31:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:31:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:31:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:31:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:31:15 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-10-21 18:31:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:31:39 [DEBUG   ] Got command RPT from MCS: ref #226991
2018-10-21 18:31:39 [DEBUG   ] summary = ERROR
2018-10-21 18:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226991  13 58412 66699905 A  ERRORERROR'
2018-10-21 18:31:40 [DEBUG   ] Got command RPT from MCS: ref #226992
2018-10-21 18:31:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226992  77 58412 66700097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:31:40 [DEBUG   ] Got command RPT from MCS: ref #226993
2018-10-21 18:31:40 [DEBUG   ] summary = ERROR
2018-10-21 18:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226993  13 58412 66700301 A  ERRORERROR'
2018-10-21 18:31:40 [DEBUG   ] Got command RPT from MCS: ref #226994
2018-10-21 18:31:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226994  77 58412 66700505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:31:40 [DEBUG   ] Got command RPT from MCS: ref #226996
2018-10-21 18:31:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   226996  12 58412 66700697 A  ERRORB™™š'
2018-10-21 18:31:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:32:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 18:32:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:32:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:32:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:32:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:32:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:32:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:32:15 [DEBUG   ] Finished updating board flags in 1.958 seconds
2018-10-21 18:32:28 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-21 18:32:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 18:33:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 18:33:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 18:33:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:33:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:33:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:33:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:33:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:33:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:33:15 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-21 18:33:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 18:33:28 [DEBUG   ] Got command RPT from MCS: ref #227005
2018-10-21 18:33:28 [DEBUG   ] summary = ERROR
2018-10-21 18:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227005  13 58412 66808665 A  ERRORERROR'
2018-10-21 18:33:28 [DEBUG   ] Got command RPT from MCS: ref #227006
2018-10-21 18:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227006  77 58412 66808666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:33:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 18:34:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-21 18:34:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 18:34:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:34:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:34:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:34:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:34:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:34:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:34:15 [DEBUG   ] Finished updating board flags in 1.869 seconds
2018-10-21 18:34:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 18:34:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 18:35:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 18:35:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:35:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:35:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:35:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:35:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:35:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:35:15 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-21 18:35:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-21 18:35:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 18:36:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 18:36:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:36:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:36:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:36:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:36:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:36:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:36:15 [DEBUG   ] Finished updating board flags in 1.898 seconds
2018-10-21 18:36:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 18:36:39 [DEBUG   ] Got command RPT from MCS: ref #227026
2018-10-21 18:36:39 [DEBUG   ] summary = ERROR
2018-10-21 18:36:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227026  13 58412 66999977 A  ERRORERROR'
2018-10-21 18:36:40 [DEBUG   ] Got command RPT from MCS: ref #227027
2018-10-21 18:36:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227027  77 58412 67000181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:36:40 [DEBUG   ] Got command RPT from MCS: ref #227028
2018-10-21 18:36:40 [DEBUG   ] summary = ERROR
2018-10-21 18:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227028  13 58412 67000385 A  ERRORERROR'
2018-10-21 18:36:40 [DEBUG   ] Got command RPT from MCS: ref #227029
2018-10-21 18:36:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227029  77 58412 67000577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:36:40 [DEBUG   ] Got command RPT from MCS: ref #227030
2018-10-21 18:36:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227030  12 58412 67000781 A  ERRORB™™š'
2018-10-21 18:36:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 18:37:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 18:37:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:37:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 18:37:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:37:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:37:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:37:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:37:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:37:15 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-21 18:37:28 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 18:37:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 18:38:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 18:38:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:38:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:38:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:38:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:38:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:38:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:38:15 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-21 18:38:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 18:38:28 [DEBUG   ] Got command RPT from MCS: ref #227031
2018-10-21 18:38:28 [DEBUG   ] summary = ERROR
2018-10-21 18:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227031  13 58412 67108669 A  ERRORERROR'
2018-10-21 18:38:28 [DEBUG   ] Got command RPT from MCS: ref #227032
2018-10-21 18:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227032  77 58412 67108670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:38:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 18:39:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 18:39:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 18:39:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:39:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:39:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:39:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:39:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:39:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:39:15 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-21 18:39:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 18:39:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:40:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:40:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:40:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:40:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:40:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:40:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:40:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:40:15 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-21 18:40:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:40:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:41:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:41:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:41:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:41:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:41:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:41:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:41:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:41:15 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-21 18:41:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:41:40 [DEBUG   ] Got command RPT from MCS: ref #227054
2018-10-21 18:41:40 [DEBUG   ] summary = ERROR
2018-10-21 18:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227054  13 58412 67300061 A  ERRORERROR'
2018-10-21 18:41:40 [DEBUG   ] Got command RPT from MCS: ref #227055
2018-10-21 18:41:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227055  77 58412 67300265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:41:40 [DEBUG   ] Got command RPT from MCS: ref #227056
2018-10-21 18:41:40 [DEBUG   ] summary = ERROR
2018-10-21 18:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227056  13 58412 67300457 A  ERRORERROR'
2018-10-21 18:41:40 [DEBUG   ] Got command RPT from MCS: ref #227058
2018-10-21 18:41:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227058  77 58412 67300661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:41:40 [DEBUG   ] Got command RPT from MCS: ref #227059
2018-10-21 18:41:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227059  12 58412 67300865 A  ERRORB™™š'
2018-10-21 18:41:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 18:42:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:42:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:42:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:42:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:42:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:42:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:42:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:42:15 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-21 18:42:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:42:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:43:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 18:43:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:43:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:43:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:43:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:43:15 [WARNING ] (13, 1, 'bot')
2018-10-21 18:43:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:43:15 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-21 18:43:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:43:28 [DEBUG   ] Got command RPT from MCS: ref #227068
2018-10-21 18:43:28 [DEBUG   ] summary = ERROR
2018-10-21 18:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227068  13 58412 67408673 A  ERRORERROR'
2018-10-21 18:43:28 [DEBUG   ] Got command RPT from MCS: ref #227069
2018-10-21 18:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227069  77 58412 67408674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:43:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:44:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:44:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:44:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:44:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:44:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:44:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:44:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:44:16 [DEBUG   ] Finished updating board flags in 2.283 seconds
2018-10-21 18:44:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:44:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:45:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:45:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 18:45:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:45:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:45:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:45:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:45:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:45:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:45:16 [DEBUG   ] Finished updating board flags in 2.146 seconds
2018-10-21 18:45:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:45:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 18:46:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:46:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:46:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:46:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:46:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:46:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:46:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:46:16 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-10-21 18:46:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:46:40 [DEBUG   ] Got command RPT from MCS: ref #227089
2018-10-21 18:46:40 [DEBUG   ] summary = ERROR
2018-10-21 18:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227089  13 58412 67600137 A  ERRORERROR'
2018-10-21 18:46:40 [DEBUG   ] Got command RPT from MCS: ref #227090
2018-10-21 18:46:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227090  77 58412 67600341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:46:40 [DEBUG   ] Got command RPT from MCS: ref #227091
2018-10-21 18:46:40 [DEBUG   ] summary = ERROR
2018-10-21 18:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227091  13 58412 67600545 A  ERRORERROR'
2018-10-21 18:46:40 [DEBUG   ] Got command RPT from MCS: ref #227092
2018-10-21 18:46:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227092  77 58412 67600749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:46:40 [DEBUG   ] Got command RPT from MCS: ref #227093
2018-10-21 18:46:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:46:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227093  12 58412 67600942 A  ERRORB™™š'
2018-10-21 18:46:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:47:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:47:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 18:47:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:47:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:47:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:47:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:47:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:47:16 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-10-21 18:47:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 18:47:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 18:48:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:48:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 18:48:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:48:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:48:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:48:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:48:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:48:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:48:16 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-10-21 18:48:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:48:28 [DEBUG   ] Got command RPT from MCS: ref #227098
2018-10-21 18:48:28 [DEBUG   ] summary = ERROR
2018-10-21 18:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227098  13 58412 67708673 A  ERRORERROR'
2018-10-21 18:48:28 [DEBUG   ] Got command RPT from MCS: ref #227099
2018-10-21 18:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227099  77 58412 67708674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:48:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:49:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:49:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:49:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:49:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:49:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:49:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:49:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:49:16 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-21 18:49:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:49:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 18:50:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 18:50:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:50:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 18:50:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:50:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:50:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:50:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:50:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:50:16 [DEBUG   ] Finished updating board flags in 1.864 seconds
2018-10-21 18:50:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 18:50:48 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-21 18:51:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:51:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:51:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:51:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:51:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:51:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:51:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:51:16 [DEBUG   ] Finished updating board flags in 1.918 seconds
2018-10-21 18:51:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:51:40 [DEBUG   ] Got command RPT from MCS: ref #227121
2018-10-21 18:51:40 [DEBUG   ] summary = ERROR
2018-10-21 18:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227121  13 58412 67900221 A  ERRORERROR'
2018-10-21 18:51:40 [DEBUG   ] Got command RPT from MCS: ref #227122
2018-10-21 18:51:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227122  77 58412 67900425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:51:40 [DEBUG   ] Got command RPT from MCS: ref #227123
2018-10-21 18:51:40 [DEBUG   ] summary = ERROR
2018-10-21 18:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227123  13 58412 67900629 A  ERRORERROR'
2018-10-21 18:51:40 [DEBUG   ] Got command RPT from MCS: ref #227125
2018-10-21 18:51:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:51:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227125  77 58412 67900821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:51:41 [DEBUG   ] Got command RPT from MCS: ref #227127
2018-10-21 18:51:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227127  12 58412 67901025 A  ERRORB™™š'
2018-10-21 18:51:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:52:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:52:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 18:52:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:52:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:52:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:52:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:52:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:52:16 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-10-21 18:52:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:52:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:53:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:53:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 18:53:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:53:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 18:53:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:53:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:53:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:53:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:53:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:53:16 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-10-21 18:53:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:53:28 [DEBUG   ] Got command RPT from MCS: ref #227131
2018-10-21 18:53:28 [DEBUG   ] summary = ERROR
2018-10-21 18:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227131  13 58412 68008673 A  ERRORERROR'
2018-10-21 18:53:28 [DEBUG   ] Got command RPT from MCS: ref #227132
2018-10-21 18:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227132  77 58412 68008674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:53:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 18:54:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:54:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:54:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:54:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:54:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:54:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:54:16 [DEBUG   ] Finished updating board flags in 1.549 seconds
2018-10-21 18:54:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 18:54:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:55:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 18:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:55:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 18:55:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:55:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:55:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:55:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:55:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:55:16 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-21 18:55:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:55:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 18:56:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 18:56:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 18:56:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:56:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:56:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:56:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:56:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:56:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:56:16 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-10-21 18:56:28 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-21 18:56:40 [DEBUG   ] Got command RPT from MCS: ref #227152
2018-10-21 18:56:40 [DEBUG   ] summary = ERROR
2018-10-21 18:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227152  13 58412 68200301 A  ERRORERROR'
2018-10-21 18:56:40 [DEBUG   ] Got command RPT from MCS: ref #227153
2018-10-21 18:56:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227153  77 58412 68200505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:56:40 [DEBUG   ] Got command RPT from MCS: ref #227154
2018-10-21 18:56:40 [DEBUG   ] summary = ERROR
2018-10-21 18:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227154  13 58412 68200709 A  ERRORERROR'
2018-10-21 18:56:40 [DEBUG   ] Got command RPT from MCS: ref #227155
2018-10-21 18:56:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:56:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227155  77 58412 68200913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:56:41 [DEBUG   ] Got command RPT from MCS: ref #227156
2018-10-21 18:56:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 18:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227156  12 58412 68201105 A  ERRORB™™š'
2018-10-21 18:56:49 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-21 18:57:09 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 18:57:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:57:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:57:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:57:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:57:16 [WARNING ] (13, 1, 'bot')
2018-10-21 18:57:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:57:16 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-10-21 18:57:29 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-10-21 18:57:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 18:58:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 18:58:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:58:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 18:58:17 [WARNING ] (13, 1, 'bot')
2018-10-21 18:58:17 [WARNING ] (13, 1, 'bot')
2018-10-21 18:58:17 [WARNING ] (13, 1, 'bot')
2018-10-21 18:58:17 [WARNING ] (13, 1, 'bot')
2018-10-21 18:58:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:58:17 [DEBUG   ] Finished updating board flags in 2.191 seconds
2018-10-21 18:58:28 [DEBUG   ] Got command RPT from MCS: ref #227161
2018-10-21 18:58:28 [DEBUG   ] summary = ERROR
2018-10-21 18:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227161  13 58412 68308677 A  ERRORERROR'
2018-10-21 18:58:28 [DEBUG   ] Got command RPT from MCS: ref #227162
2018-10-21 18:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 18:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227162  77 58412 68308678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 18:58:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 18:58:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 18:59:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 18:59:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 18:59:17 [WARNING ] (13, 1, 'bot')
2018-10-21 18:59:17 [WARNING ] (13, 1, 'bot')
2018-10-21 18:59:17 [WARNING ] (13, 1, 'bot')
2018-10-21 18:59:17 [WARNING ] (13, 1, 'bot')
2018-10-21 18:59:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 18:59:17 [DEBUG   ] Finished updating board flags in 1.921 seconds
2018-10-21 18:59:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 18:59:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:00:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 19:00:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:00:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:00:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:00:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:00:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:00:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:00:17 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-10-21 19:00:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:00:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 19:01:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:01:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:01:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 19:01:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:01:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:01:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:01:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:01:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:01:17 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-10-21 19:01:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 19:01:40 [DEBUG   ] Got command RPT from MCS: ref #227184
2018-10-21 19:01:40 [DEBUG   ] summary = ERROR
2018-10-21 19:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227184  13 58412 68500389 A  ERRORERROR'
2018-10-21 19:01:40 [DEBUG   ] Got command RPT from MCS: ref #227185
2018-10-21 19:01:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227185  77 58412 68500593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:01:40 [DEBUG   ] Got command RPT from MCS: ref #227186
2018-10-21 19:01:40 [DEBUG   ] summary = ERROR
2018-10-21 19:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227186  13 58412 68500803 A  ERRORERROR'
2018-10-21 19:01:40 [DEBUG   ] Got command RPT from MCS: ref #227188
2018-10-21 19:01:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227188  77 58412 68501021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:01:41 [DEBUG   ] Got command RPT from MCS: ref #227190
2018-10-21 19:01:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227190  12 58412 68501185 A  ERRORB™™š'
2018-10-21 19:01:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:02:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:02:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:02:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 19:02:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:02:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:02:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:02:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:02:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:02:17 [DEBUG   ] Finished updating board flags in 1.834 seconds
2018-10-21 19:02:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:02:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 19:03:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:03:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 19:03:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:03:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 19:03:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:03:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:03:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:03:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:03:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:03:17 [DEBUG   ] Finished updating board flags in 1.762 seconds
2018-10-21 19:03:28 [DEBUG   ] Got command RPT from MCS: ref #227198
2018-10-21 19:03:28 [DEBUG   ] summary = ERROR
2018-10-21 19:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227198  13 58412 68608669 A  ERRORERROR'
2018-10-21 19:03:28 [DEBUG   ] Got command RPT from MCS: ref #227199
2018-10-21 19:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227199  77 58412 68608670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:03:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 19:03:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:04:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 19:04:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:04:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 19:04:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:04:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:04:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:04:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:04:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:04:17 [DEBUG   ] Finished updating board flags in 1.680 seconds
2018-10-21 19:04:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:04:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 19:05:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:05:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:05:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 19:05:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:05:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:05:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:05:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:05:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:05:17 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-21 19:05:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 19:05:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 19:06:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 19:06:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:06:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:06:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:06:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:06:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:06:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:06:17 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-10-21 19:06:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 19:06:40 [DEBUG   ] Got command RPT from MCS: ref #227219
2018-10-21 19:06:40 [DEBUG   ] summary = ERROR
2018-10-21 19:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227219  13 58412 68800465 A  ERRORERROR'
2018-10-21 19:06:40 [DEBUG   ] Got command RPT from MCS: ref #227220
2018-10-21 19:06:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227220  77 58412 68800669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:06:40 [DEBUG   ] Got command RPT from MCS: ref #227221
2018-10-21 19:06:40 [DEBUG   ] summary = ERROR
2018-10-21 19:06:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227221  13 58412 68800873 A  ERRORERROR'
2018-10-21 19:06:41 [DEBUG   ] Got command RPT from MCS: ref #227222
2018-10-21 19:06:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227222  77 58412 68801065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:06:41 [DEBUG   ] Got command RPT from MCS: ref #227223
2018-10-21 19:06:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227223  12 58412 68801269 A  ERRORB™™š'
2018-10-21 19:06:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 19:07:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 19:07:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:07:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:07:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:07:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:07:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:07:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:07:17 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-10-21 19:07:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 19:07:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 19:08:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 19:08:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:08:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 19:08:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:08:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:08:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:08:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:08:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:08:17 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-10-21 19:08:28 [DEBUG   ] Got command RPT from MCS: ref #227224
2018-10-21 19:08:28 [DEBUG   ] summary = ERROR
2018-10-21 19:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227224  13 58412 68908669 A  ERRORERROR'
2018-10-21 19:08:28 [DEBUG   ] Got command RPT from MCS: ref #227225
2018-10-21 19:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227225  77 58412 68908670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:08:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 19:08:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 19:09:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 19:09:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:09:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:09:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:09:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:09:17 [WARNING ] (13, 1, 'bot')
2018-10-21 19:09:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:09:17 [DEBUG   ] Finished updating board flags in 1.519 seconds
2018-10-21 19:09:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 19:09:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 19:10:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 19:10:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:10:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 19:10:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:10:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:10:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:10:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:10:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:10:18 [DEBUG   ] Finished updating board flags in 2.173 seconds
2018-10-21 19:10:29 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 19:10:49 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-21 19:11:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 19:11:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:11:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:11:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:11:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:11:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:11:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:11:18 [DEBUG   ] Finished updating board flags in 1.921 seconds
2018-10-21 19:11:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 19:11:40 [DEBUG   ] Got command RPT from MCS: ref #227247
2018-10-21 19:11:40 [DEBUG   ] summary = ERROR
2018-10-21 19:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227247  13 58412 69100553 A  ERRORERROR'
2018-10-21 19:11:40 [DEBUG   ] Got command RPT from MCS: ref #227248
2018-10-21 19:11:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227248  77 58412 69100745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:11:40 [DEBUG   ] Got command RPT from MCS: ref #227249
2018-10-21 19:11:40 [DEBUG   ] summary = ERROR
2018-10-21 19:11:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227249  13 58412 69100950 A  ERRORERROR'
2018-10-21 19:11:41 [DEBUG   ] Got command RPT from MCS: ref #227251
2018-10-21 19:11:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227251  77 58412 69101153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:11:41 [DEBUG   ] Got command RPT from MCS: ref #227252
2018-10-21 19:11:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227252  12 58412 69101357 A  ERRORB™™š'
2018-10-21 19:11:50 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-21 19:12:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:12:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:12:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:12:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:12:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:12:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:12:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:12:18 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-10-21 19:12:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:12:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 19:13:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:13:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:13:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 19:13:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 19:13:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:13:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:13:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:13:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:13:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:13:18 [DEBUG   ] Finished updating board flags in 1.850 seconds
2018-10-21 19:13:28 [DEBUG   ] Got command RPT from MCS: ref #227261
2018-10-21 19:13:28 [DEBUG   ] summary = ERROR
2018-10-21 19:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227261  13 58412 69208674 A  ERRORERROR'
2018-10-21 19:13:28 [DEBUG   ] Got command RPT from MCS: ref #227262
2018-10-21 19:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227262  77 58412 69208674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:13:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 19:13:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:14:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:14:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:14:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:14:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:14:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:14:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:14:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:14:18 [DEBUG   ] Finished updating board flags in 1.752 seconds
2018-10-21 19:14:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:14:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:15:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:15:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:15:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:15:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:15:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:15:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:15:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:15:18 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-10-21 19:15:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 19:15:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:16:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:16:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:16:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:16:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:16:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:16:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:16:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:16:18 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-21 19:16:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:16:40 [DEBUG   ] Got command RPT from MCS: ref #227282
2018-10-21 19:16:40 [DEBUG   ] summary = ERROR
2018-10-21 19:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227282  13 58412 69400625 A  ERRORERROR'
2018-10-21 19:16:40 [DEBUG   ] Got command RPT from MCS: ref #227283
2018-10-21 19:16:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:16:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227283  77 58412 69400829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:16:41 [DEBUG   ] Got command RPT from MCS: ref #227284
2018-10-21 19:16:41 [DEBUG   ] summary = ERROR
2018-10-21 19:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227284  13 58412 69401033 A  ERRORERROR'
2018-10-21 19:16:41 [DEBUG   ] Got command RPT from MCS: ref #227285
2018-10-21 19:16:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227285  77 58412 69401225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:16:41 [DEBUG   ] Got command RPT from MCS: ref #227286
2018-10-21 19:16:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227286  12 58412 69401429 A  ERRORB™™š'
2018-10-21 19:16:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 19:17:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:17:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:17:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 19:17:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:17:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:17:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:17:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:17:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:17:18 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-21 19:17:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:17:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:18:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:18:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:18:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:18:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:18:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:18:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:18:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:18:18 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-10-21 19:18:28 [DEBUG   ] Got command RPT from MCS: ref #227291
2018-10-21 19:18:28 [DEBUG   ] summary = ERROR
2018-10-21 19:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227291  13 58412 69508681 A  ERRORERROR'
2018-10-21 19:18:28 [DEBUG   ] Got command RPT from MCS: ref #227292
2018-10-21 19:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227292  77 58412 69508682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:18:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:18:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:19:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:19:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 19:19:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:19:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 19:19:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:19:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:19:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:19:18 [WARNING ] (13, 1, 'bot')
2018-10-21 19:19:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:19:18 [DEBUG   ] Finished updating board flags in 1.563 seconds
2018-10-21 19:19:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 19:19:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:20:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:20:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:20:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:20:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:20:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:20:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:20:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:20:19 [DEBUG   ] Finished updating board flags in 2.242 seconds
2018-10-21 19:20:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 19:20:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 19:21:11 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-10-21 19:21:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 19:21:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:21:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:21:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:21:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:21:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:21:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:21:19 [DEBUG   ] Finished updating board flags in 2.093 seconds
2018-10-21 19:21:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 19:21:40 [DEBUG   ] Got command RPT from MCS: ref #227314
2018-10-21 19:21:40 [DEBUG   ] summary = ERROR
2018-10-21 19:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227314  13 58412 69700705 A  ERRORERROR'
2018-10-21 19:21:40 [DEBUG   ] Got command RPT from MCS: ref #227315
2018-10-21 19:21:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:21:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227315  77 58412 69700909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:21:41 [DEBUG   ] Got command RPT from MCS: ref #227316
2018-10-21 19:21:41 [DEBUG   ] summary = ERROR
2018-10-21 19:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227316  13 58412 69701113 A  ERRORERROR'
2018-10-21 19:21:41 [DEBUG   ] Got command RPT from MCS: ref #227318
2018-10-21 19:21:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227318  77 58412 69701317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:21:41 [DEBUG   ] Got command RPT from MCS: ref #227319
2018-10-21 19:21:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227319  12 58412 69701509 A  ERRORB™™š'
2018-10-21 19:21:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 19:22:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 19:22:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 19:22:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:22:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:22:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:22:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:22:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:22:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:22:19 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-21 19:22:30 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-21 19:22:51 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-21 19:23:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 19:23:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 19:23:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:23:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:23:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:23:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:23:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:23:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:23:19 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-21 19:23:28 [DEBUG   ] Got command RPT from MCS: ref #227324
2018-10-21 19:23:28 [DEBUG   ] summary = ERROR
2018-10-21 19:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227324  13 58412 69808681 A  ERRORERROR'
2018-10-21 19:23:28 [DEBUG   ] Got command RPT from MCS: ref #227325
2018-10-21 19:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227325  77 58412 69808682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:23:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-21 19:23:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 19:24:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 19:24:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 19:24:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:24:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:24:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:24:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:24:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:24:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:24:19 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-10-21 19:24:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 19:24:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 19:25:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:25:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:25:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:25:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:25:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:25:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:25:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:25:19 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-10-21 19:25:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:25:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 19:26:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:26:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:26:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:26:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:26:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:26:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:26:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:26:19 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-21 19:26:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:26:40 [DEBUG   ] Got command RPT from MCS: ref #227345
2018-10-21 19:26:40 [DEBUG   ] summary = ERROR
2018-10-21 19:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227345  13 58412 70000789 A  ERRORERROR'
2018-10-21 19:26:40 [DEBUG   ] Got command RPT from MCS: ref #227346
2018-10-21 19:26:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:26:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227346  77 58412 70000993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:26:41 [DEBUG   ] Got command RPT from MCS: ref #227347
2018-10-21 19:26:41 [DEBUG   ] summary = ERROR
2018-10-21 19:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227347  13 58412 70001185 A  ERRORERROR'
2018-10-21 19:26:41 [DEBUG   ] Got command RPT from MCS: ref #227348
2018-10-21 19:26:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227348  77 58412 70001389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:26:41 [DEBUG   ] Got command RPT from MCS: ref #227349
2018-10-21 19:26:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227349  12 58412 70001593 A  ERRORB™™š'
2018-10-21 19:26:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:27:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 19:27:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:27:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:27:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:27:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:27:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:27:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:27:19 [DEBUG   ] Finished updating board flags in 1.663 seconds
2018-10-21 19:27:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 19:27:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:28:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:28:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:28:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 19:28:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:28:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:28:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:28:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:28:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:28:19 [DEBUG   ] Finished updating board flags in 1.640 seconds
2018-10-21 19:28:28 [DEBUG   ] Got command RPT from MCS: ref #227354
2018-10-21 19:28:28 [DEBUG   ] summary = ERROR
2018-10-21 19:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227354  13 58412 70108673 A  ERRORERROR'
2018-10-21 19:28:28 [DEBUG   ] Got command RPT from MCS: ref #227355
2018-10-21 19:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227355  77 58412 70108674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:28:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 19:28:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:29:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:29:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:29:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 19:29:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:29:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:29:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:29:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:29:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:29:19 [DEBUG   ] Finished updating board flags in 1.485 seconds
2018-10-21 19:29:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:29:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 19:30:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 19:30:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:30:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:30:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:30:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:30:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:30:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:30:19 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-10-21 19:30:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 19:30:51 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 19:31:11 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-21 19:31:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:31:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:31:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:31:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:31:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:31:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:31:19 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-10-21 19:31:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 19:31:40 [DEBUG   ] Got command RPT from MCS: ref #227377
2018-10-21 19:31:40 [DEBUG   ] summary = ERROR
2018-10-21 19:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227377  13 58412 70300869 A  ERRORERROR'
2018-10-21 19:31:41 [DEBUG   ] Got command RPT from MCS: ref #227378
2018-10-21 19:31:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227378  77 58412 70301073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:31:41 [DEBUG   ] Got command RPT from MCS: ref #227379
2018-10-21 19:31:41 [DEBUG   ] summary = ERROR
2018-10-21 19:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227379  13 58412 70301265 A  ERRORERROR'
2018-10-21 19:31:41 [DEBUG   ] Got command RPT from MCS: ref #227381
2018-10-21 19:31:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227381  77 58412 70301469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:31:41 [DEBUG   ] Got command RPT from MCS: ref #227382
2018-10-21 19:31:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227382  12 58412 70301673 A  ERRORBš™š'
2018-10-21 19:31:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 19:32:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-21 19:32:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 19:32:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:32:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:32:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:32:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:32:19 [WARNING ] (13, 1, 'bot')
2018-10-21 19:32:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:32:19 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-10-21 19:32:32 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-21 19:32:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:33:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:33:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 19:33:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:33:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:33:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:33:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:33:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:33:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:33:20 [DEBUG   ] Finished updating board flags in 2.167 seconds
2018-10-21 19:33:28 [DEBUG   ] Got command RPT from MCS: ref #227391
2018-10-21 19:33:28 [DEBUG   ] summary = ERROR
2018-10-21 19:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227391  13 58412 70408681 A  ERRORERROR'
2018-10-21 19:33:28 [DEBUG   ] Got command RPT from MCS: ref #227392
2018-10-21 19:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227392  77 58412 70408682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:33:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:33:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:34:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:34:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:34:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 19:34:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:34:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:34:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:34:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:34:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:34:20 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-10-21 19:34:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:34:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:35:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:35:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 19:35:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 19:35:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:35:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:35:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:35:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:35:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:35:20 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-21 19:35:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:35:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:36:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:36:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 19:36:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:36:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:36:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:36:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:36:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:36:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:36:20 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-10-21 19:36:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:36:40 [DEBUG   ] Got command RPT from MCS: ref #227412
2018-10-21 19:36:40 [DEBUG   ] summary = ERROR
2018-10-21 19:36:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227412  13 58412 70600953 A  ERRORERROR'
2018-10-21 19:36:41 [DEBUG   ] Got command RPT from MCS: ref #227413
2018-10-21 19:36:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227413  77 58412 70601145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:36:41 [DEBUG   ] Got command RPT from MCS: ref #227414
2018-10-21 19:36:41 [DEBUG   ] summary = ERROR
2018-10-21 19:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227414  13 58412 70601349 A  ERRORERROR'
2018-10-21 19:36:41 [DEBUG   ] Got command RPT from MCS: ref #227415
2018-10-21 19:36:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227415  77 58412 70601553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:36:41 [DEBUG   ] Got command RPT from MCS: ref #227416
2018-10-21 19:36:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227416  12 58412 70601757 A  ERRORBš™š'
2018-10-21 19:36:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:37:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:37:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:37:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 19:37:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 19:37:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:37:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:37:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:37:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:37:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:37:20 [DEBUG   ] Finished updating board flags in 1.702 seconds
2018-10-21 19:37:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:37:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:38:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:38:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 19:38:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:38:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 19:38:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:38:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:38:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:38:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:38:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:38:20 [DEBUG   ] Finished updating board flags in 1.639 seconds
2018-10-21 19:38:28 [DEBUG   ] Got command RPT from MCS: ref #227417
2018-10-21 19:38:28 [DEBUG   ] summary = ERROR
2018-10-21 19:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227417  13 58412 70708681 A  ERRORERROR'
2018-10-21 19:38:28 [DEBUG   ] Got command RPT from MCS: ref #227418
2018-10-21 19:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227418  77 58412 70708682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:38:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:38:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 19:39:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:39:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:39:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 19:39:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 19:39:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:39:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:39:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:39:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:39:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:39:20 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-10-21 19:39:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:39:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:40:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:40:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:40:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:40:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:40:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:40:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:40:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:40:20 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-10-21 19:40:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:40:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:41:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:41:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:41:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:41:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:41:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:41:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:41:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:41:20 [DEBUG   ] Finished updating board flags in 1.483 seconds
2018-10-21 19:41:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:41:41 [DEBUG   ] Got command RPT from MCS: ref #227440
2018-10-21 19:41:41 [DEBUG   ] summary = ERROR
2018-10-21 19:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227440  13 58412 70901029 A  ERRORERROR'
2018-10-21 19:41:41 [DEBUG   ] Got command RPT from MCS: ref #227441
2018-10-21 19:41:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227441  77 58412 70901233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:41:41 [DEBUG   ] Got command RPT from MCS: ref #227442
2018-10-21 19:41:41 [DEBUG   ] summary = ERROR
2018-10-21 19:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227442  13 58412 70901437 A  ERRORERROR'
2018-10-21 19:41:41 [DEBUG   ] Got command RPT from MCS: ref #227444
2018-10-21 19:41:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227444  77 58412 70901629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:41:41 [DEBUG   ] Got command RPT from MCS: ref #227445
2018-10-21 19:41:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227445  12 58412 70901833 A  ERRORBš™š'
2018-10-21 19:41:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:42:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:42:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:42:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 19:42:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:42:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:42:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:42:20 [WARNING ] (13, 1, 'bot')
2018-10-21 19:42:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:42:20 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-21 19:42:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:42:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:43:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:43:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:43:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 19:43:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:43:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:43:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:43:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:43:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:43:21 [DEBUG   ] Finished updating board flags in 2.246 seconds
2018-10-21 19:43:28 [DEBUG   ] Got command RPT from MCS: ref #227454
2018-10-21 19:43:28 [DEBUG   ] summary = ERROR
2018-10-21 19:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227454  13 58412 71008685 A  ERRORERROR'
2018-10-21 19:43:28 [DEBUG   ] Got command RPT from MCS: ref #227455
2018-10-21 19:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227455  77 58412 71008686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:43:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:43:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:44:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:44:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:44:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:44:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:44:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:44:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:44:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:44:21 [DEBUG   ] Finished updating board flags in 2.093 seconds
2018-10-21 19:44:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:44:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:45:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:45:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:45:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:45:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:45:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:45:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:45:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:45:21 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-10-21 19:45:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:45:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:46:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:46:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:46:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 19:46:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 19:46:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:46:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:46:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:46:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:46:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:46:21 [DEBUG   ] Finished updating board flags in 1.973 seconds
2018-10-21 19:46:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:46:41 [DEBUG   ] Got command RPT from MCS: ref #227475
2018-10-21 19:46:41 [DEBUG   ] summary = ERROR
2018-10-21 19:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227475  13 58412 71201113 A  ERRORERROR'
2018-10-21 19:46:41 [DEBUG   ] Got command RPT from MCS: ref #227476
2018-10-21 19:46:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227476  77 58412 71201317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:46:41 [DEBUG   ] Got command RPT from MCS: ref #227477
2018-10-21 19:46:41 [DEBUG   ] summary = ERROR
2018-10-21 19:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227477  13 58412 71201509 A  ERRORERROR'
2018-10-21 19:46:41 [DEBUG   ] Got command RPT from MCS: ref #227478
2018-10-21 19:46:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227478  77 58412 71201713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:46:41 [DEBUG   ] Got command RPT from MCS: ref #227479
2018-10-21 19:46:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227479  12 58412 71201917 A  ERRORBš™š'
2018-10-21 19:46:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:47:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:47:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:47:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 19:47:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:47:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:47:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:47:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:47:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:47:21 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-21 19:47:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:47:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:48:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 19:48:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:48:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 19:48:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 19:48:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:48:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:48:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:48:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:48:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:48:21 [DEBUG   ] Finished updating board flags in 1.901 seconds
2018-10-21 19:48:28 [DEBUG   ] Got command RPT from MCS: ref #227484
2018-10-21 19:48:28 [DEBUG   ] summary = ERROR
2018-10-21 19:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227484  13 58412 71308689 A  ERRORERROR'
2018-10-21 19:48:28 [DEBUG   ] Got command RPT from MCS: ref #227485
2018-10-21 19:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227485  77 58412 71308690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:48:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:48:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:49:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:49:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 19:49:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:49:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 19:49:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:49:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:49:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:49:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:49:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:49:21 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-21 19:49:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:49:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:50:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:50:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 19:50:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:50:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 19:50:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:50:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:50:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:50:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:50:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:50:21 [DEBUG   ] Finished updating board flags in 1.671 seconds
2018-10-21 19:50:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:50:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:51:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:51:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 19:51:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:51:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 19:51:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:51:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:51:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:51:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:51:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:51:21 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-10-21 19:51:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 19:51:41 [DEBUG   ] Got command RPT from MCS: ref #227507
2018-10-21 19:51:41 [DEBUG   ] summary = ERROR
2018-10-21 19:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227507  13 58412 71501189 A  ERRORERROR'
2018-10-21 19:51:41 [DEBUG   ] Got command RPT from MCS: ref #227508
2018-10-21 19:51:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227508  77 58412 71501393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:51:41 [DEBUG   ] Got command RPT from MCS: ref #227509
2018-10-21 19:51:41 [DEBUG   ] summary = ERROR
2018-10-21 19:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227509  13 58412 71501597 A  ERRORERROR'
2018-10-21 19:51:41 [DEBUG   ] Got command RPT from MCS: ref #227511
2018-10-21 19:51:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227511  77 58412 71501789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:51:41 [DEBUG   ] Got command RPT from MCS: ref #227512
2018-10-21 19:51:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227512  12 58412 71501993 A  ERRORBš™š'
2018-10-21 19:51:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 19:52:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 19:52:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:52:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:52:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:52:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:52:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:52:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:52:21 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-21 19:52:32 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 19:52:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 19:53:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:53:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:53:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 19:53:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:53:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:53:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:53:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:53:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:53:21 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-10-21 19:53:28 [DEBUG   ] Got command RPT from MCS: ref #227517
2018-10-21 19:53:28 [DEBUG   ] summary = ERROR
2018-10-21 19:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227517  13 58412 71608681 A  ERRORERROR'
2018-10-21 19:53:28 [DEBUG   ] Got command RPT from MCS: ref #227518
2018-10-21 19:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227518  77 58412 71608682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:53:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:53:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 19:54:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 19:54:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:54:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 19:54:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:54:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:54:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:54:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:54:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:54:21 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-21 19:54:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 19:54:52 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-10-21 19:55:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 19:55:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:55:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:55:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:55:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:55:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:55:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:55:21 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-10-21 19:55:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 19:55:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 19:56:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-21 19:56:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 19:56:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:56:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:56:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:56:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:56:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:56:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:56:21 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-21 19:56:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-21 19:56:41 [DEBUG   ] Got command RPT from MCS: ref #227538
2018-10-21 19:56:41 [DEBUG   ] summary = ERROR
2018-10-21 19:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227538  13 58412 71801273 A  ERRORERROR'
2018-10-21 19:56:41 [DEBUG   ] Got command RPT from MCS: ref #227539
2018-10-21 19:56:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227539  77 58412 71801477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:56:41 [DEBUG   ] Got command RPT from MCS: ref #227540
2018-10-21 19:56:41 [DEBUG   ] summary = ERROR
2018-10-21 19:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227540  13 58412 71801669 A  ERRORERROR'
2018-10-21 19:56:41 [DEBUG   ] Got command RPT from MCS: ref #227541
2018-10-21 19:56:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:56:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227541  77 58412 71801873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:56:42 [DEBUG   ] Got command RPT from MCS: ref #227542
2018-10-21 19:56:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 19:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227542  12 58412 71802077 A  ERRORBš™š'
2018-10-21 19:56:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 19:57:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 19:57:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 19:57:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:57:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 19:57:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 19:57:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:57:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:57:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:57:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:57:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:57:21 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-21 19:57:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 19:57:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 19:58:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 19:58:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:58:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:58:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:58:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:58:21 [WARNING ] (13, 1, 'bot')
2018-10-21 19:58:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:58:21 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-10-21 19:58:28 [DEBUG   ] Got command RPT from MCS: ref #227547
2018-10-21 19:58:28 [DEBUG   ] summary = ERROR
2018-10-21 19:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227547  13 58412 71908681 A  ERRORERROR'
2018-10-21 19:58:28 [DEBUG   ] Got command RPT from MCS: ref #227548
2018-10-21 19:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 19:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227548  77 58412 71908682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 19:58:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 19:58:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 19:59:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 19:59:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 19:59:22 [WARNING ] (13, 1, 'bot')
2018-10-21 19:59:22 [WARNING ] (13, 1, 'bot')
2018-10-21 19:59:22 [WARNING ] (13, 1, 'bot')
2018-10-21 19:59:22 [WARNING ] (13, 1, 'bot')
2018-10-21 19:59:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 19:59:22 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-10-21 19:59:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 19:59:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:00:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:00:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:00:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 20:00:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:00:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:00:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:00:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:00:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:00:22 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-10-21 20:00:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 20:00:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 20:01:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:01:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:01:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 20:01:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:01:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:01:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:01:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:01:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:01:22 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-10-21 20:01:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:01:41 [DEBUG   ] Got command RPT from MCS: ref #227570
2018-10-21 20:01:41 [DEBUG   ] summary = ERROR
2018-10-21 20:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227570  13 58412 72101349 A  ERRORERROR'
2018-10-21 20:01:41 [DEBUG   ] Got command RPT from MCS: ref #227571
2018-10-21 20:01:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227571  77 58412 72101553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:01:41 [DEBUG   ] Got command RPT from MCS: ref #227572
2018-10-21 20:01:41 [DEBUG   ] summary = ERROR
2018-10-21 20:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227572  13 58412 72101757 A  ERRORERROR'
2018-10-21 20:01:41 [DEBUG   ] Got command RPT from MCS: ref #227574
2018-10-21 20:01:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:01:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227574  77 58412 72101949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:01:42 [DEBUG   ] Got command RPT from MCS: ref #227576
2018-10-21 20:01:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227576  12 58412 72102153 A  ERRORBš™š'
2018-10-21 20:01:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 20:02:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 20:02:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 20:02:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:02:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:02:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:02:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:02:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:02:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:02:22 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-21 20:02:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:02:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:03:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 20:03:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 20:03:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:03:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 20:03:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:03:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:03:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:03:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:03:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:03:22 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-21 20:03:28 [DEBUG   ] Got command RPT from MCS: ref #227589
2018-10-21 20:03:28 [DEBUG   ] summary = ERROR
2018-10-21 20:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227589  13 58412 72208689 A  ERRORERROR'
2018-10-21 20:03:28 [DEBUG   ] Got command RPT from MCS: ref #227590
2018-10-21 20:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227590  77 58412 72208690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:03:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 20:03:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:04:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:04:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 20:04:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:04:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:04:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:04:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:04:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:04:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:04:22 [DEBUG   ] Finished updating board flags in 1.909 seconds
2018-10-21 20:04:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 20:04:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 20:05:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:05:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:05:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 20:05:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:05:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:05:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:05:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:05:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:05:22 [DEBUG   ] Finished updating board flags in 1.675 seconds
2018-10-21 20:05:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:05:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 20:06:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 20:06:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:06:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:06:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:06:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:06:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:06:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:06:22 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-10-21 20:06:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:06:41 [DEBUG   ] Got command RPT from MCS: ref #227615
2018-10-21 20:06:41 [DEBUG   ] summary = ERROR
2018-10-21 20:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227615  13 58412 72401433 A  ERRORERROR'
2018-10-21 20:06:41 [DEBUG   ] Got command RPT from MCS: ref #227616
2018-10-21 20:06:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227616  77 58412 72401637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:06:41 [DEBUG   ] Got command RPT from MCS: ref #227617
2018-10-21 20:06:41 [DEBUG   ] summary = ERROR
2018-10-21 20:06:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227617  13 58412 72401829 A  ERRORERROR'
2018-10-21 20:06:42 [DEBUG   ] Got command RPT from MCS: ref #227618
2018-10-21 20:06:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227618  77 58412 72402033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:06:42 [DEBUG   ] Got command RPT from MCS: ref #227619
2018-10-21 20:06:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227619  12 58412 72402237 A  ERRORBš™š'
2018-10-21 20:06:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:07:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 20:07:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:07:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 20:07:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:07:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:07:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:07:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:07:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:07:22 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-21 20:07:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:07:53 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-21 20:08:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:08:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:08:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 20:08:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:08:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:08:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:08:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:08:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:08:22 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-10-21 20:08:28 [DEBUG   ] Got command RPT from MCS: ref #227620
2018-10-21 20:08:28 [DEBUG   ] summary = ERROR
2018-10-21 20:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227620  13 58412 72508689 A  ERRORERROR'
2018-10-21 20:08:28 [DEBUG   ] Got command RPT from MCS: ref #227621
2018-10-21 20:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227621  77 58412 72508690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:08:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:08:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 20:09:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:09:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:09:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 20:09:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 20:09:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:09:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:09:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:09:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:09:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:09:22 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-10-21 20:09:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:09:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:10:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 20:10:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:10:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 20:10:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:10:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:10:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:10:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:10:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:10:22 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-10-21 20:10:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:10:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:11:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:11:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 20:11:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:11:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 20:11:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:11:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:11:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:11:22 [WARNING ] (13, 1, 'bot')
2018-10-21 20:11:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:11:22 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-10-21 20:11:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 20:11:41 [DEBUG   ] Got command RPT from MCS: ref #227643
2018-10-21 20:11:41 [DEBUG   ] summary = ERROR
2018-10-21 20:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227643  13 58412 72701509 A  ERRORERROR'
2018-10-21 20:11:41 [DEBUG   ] Got command RPT from MCS: ref #227644
2018-10-21 20:11:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227644  77 58412 72701713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:11:41 [DEBUG   ] Got command RPT from MCS: ref #227645
2018-10-21 20:11:41 [DEBUG   ] summary = ERROR
2018-10-21 20:11:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227645  13 58412 72701917 A  ERRORERROR'
2018-10-21 20:11:42 [DEBUG   ] Got command RPT from MCS: ref #227647
2018-10-21 20:11:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227647  77 58412 72702109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:11:42 [DEBUG   ] Got command RPT from MCS: ref #227648
2018-10-21 20:11:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227648  12 58412 72702313 A  ERRORBš™š'
2018-10-21 20:11:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:12:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 20:12:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:12:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:12:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:12:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:12:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:12:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:12:23 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-21 20:12:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:12:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 20:13:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:13:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:13:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:13:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:13:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:13:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:13:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:13:23 [DEBUG   ] Finished updating board flags in 2.150 seconds
2018-10-21 20:13:28 [DEBUG   ] Got command RPT from MCS: ref #227657
2018-10-21 20:13:28 [DEBUG   ] summary = ERROR
2018-10-21 20:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227657  13 58412 72808693 A  ERRORERROR'
2018-10-21 20:13:28 [DEBUG   ] Got command RPT from MCS: ref #227658
2018-10-21 20:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227658  77 58412 72808694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:13:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:13:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:14:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 20:14:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:14:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 20:14:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:14:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:14:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:14:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:14:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:14:23 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-21 20:14:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:14:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 20:15:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 20:15:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:15:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 20:15:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:15:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:15:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:15:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:15:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:15:23 [DEBUG   ] Finished updating board flags in 1.878 seconds
2018-10-21 20:15:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 20:15:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:16:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:16:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:16:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 20:16:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:16:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:16:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:16:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:16:23 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-21 20:16:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 20:16:41 [DEBUG   ] Got command RPT from MCS: ref #227678
2018-10-21 20:16:41 [DEBUG   ] summary = ERROR
2018-10-21 20:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227678  13 58412 73001593 A  ERRORERROR'
2018-10-21 20:16:41 [DEBUG   ] Got command RPT from MCS: ref #227679
2018-10-21 20:16:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227679  77 58412 73001797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:16:41 [DEBUG   ] Got command RPT from MCS: ref #227680
2018-10-21 20:16:41 [DEBUG   ] summary = ERROR
2018-10-21 20:16:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227680  13 58412 73001989 A  ERRORERROR'
2018-10-21 20:16:42 [DEBUG   ] Got command RPT from MCS: ref #227681
2018-10-21 20:16:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227681  77 58412 73002193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:16:42 [DEBUG   ] Got command RPT from MCS: ref #227682
2018-10-21 20:16:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227682  12 58412 73002397 A  ERRORB›™š'
2018-10-21 20:16:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 20:17:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:17:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:17:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:17:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:17:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:17:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:17:23 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-10-21 20:17:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:17:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 20:18:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 20:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:18:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 20:18:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:18:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:18:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:18:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:18:23 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-10-21 20:18:28 [DEBUG   ] Got command RPT from MCS: ref #227687
2018-10-21 20:18:28 [DEBUG   ] summary = ERROR
2018-10-21 20:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227687  13 58412 73108685 A  ERRORERROR'
2018-10-21 20:18:28 [DEBUG   ] Got command RPT from MCS: ref #227688
2018-10-21 20:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227688  77 58412 73108686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:18:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:18:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:19:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 20:19:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:19:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:19:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:19:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:19:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:19:23 [DEBUG   ] Finished updating board flags in 1.659 seconds
2018-10-21 20:19:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 20:19:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:20:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:20:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:20:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 20:20:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 20:20:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:20:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:20:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:20:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:20:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:20:23 [DEBUG   ] Finished updating board flags in 1.661 seconds
2018-10-21 20:20:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 20:20:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 20:21:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 20:21:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:21:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:21:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:21:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:21:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:21:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:21:23 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-10-21 20:21:34 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-21 20:21:41 [DEBUG   ] Got command RPT from MCS: ref #227710
2018-10-21 20:21:41 [DEBUG   ] summary = ERROR
2018-10-21 20:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227710  13 58412 73301673 A  ERRORERROR'
2018-10-21 20:21:41 [DEBUG   ] Got command RPT from MCS: ref #227711
2018-10-21 20:21:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:21:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227711  77 58412 73301877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:21:42 [DEBUG   ] Got command RPT from MCS: ref #227712
2018-10-21 20:21:42 [DEBUG   ] summary = ERROR
2018-10-21 20:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227712  13 58412 73302069 A  ERRORERROR'
2018-10-21 20:21:42 [DEBUG   ] Got command RPT from MCS: ref #227714
2018-10-21 20:21:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227714  77 58412 73302273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:21:42 [DEBUG   ] Got command RPT from MCS: ref #227715
2018-10-21 20:21:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227715  12 58412 73302477 A  ERRORBš™š'
2018-10-21 20:21:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 20:22:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:22:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:22:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:22:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:22:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:22:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:22:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:22:23 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-10-21 20:22:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:22:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:23:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:23:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:23:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:23:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:23:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:23:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:23:23 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-10-21 20:23:28 [DEBUG   ] Got command RPT from MCS: ref #227720
2018-10-21 20:23:28 [DEBUG   ] summary = ERROR
2018-10-21 20:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227720  13 58412 73408693 A  ERRORERROR'
2018-10-21 20:23:28 [DEBUG   ] Got command RPT from MCS: ref #227721
2018-10-21 20:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227721  77 58412 73408694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:23:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:23:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:24:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:24:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:24:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:24:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:24:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:24:23 [WARNING ] (13, 1, 'bot')
2018-10-21 20:24:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:24:23 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-10-21 20:24:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:24:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:25:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:25:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:25:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:25:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:25:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:25:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:25:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:25:24 [DEBUG   ] Finished updating board flags in 2.191 seconds
2018-10-21 20:25:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:25:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:26:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:26:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:26:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 20:26:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 20:26:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:26:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:26:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:26:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:26:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:26:24 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-10-21 20:26:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:26:41 [DEBUG   ] Got command RPT from MCS: ref #227741
2018-10-21 20:26:41 [DEBUG   ] summary = ERROR
2018-10-21 20:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227741  13 58412 73601757 A  ERRORERROR'
2018-10-21 20:26:41 [DEBUG   ] Got command RPT from MCS: ref #227742
2018-10-21 20:26:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:26:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227742  77 58412 73601949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:26:42 [DEBUG   ] Got command RPT from MCS: ref #227743
2018-10-21 20:26:42 [DEBUG   ] summary = ERROR
2018-10-21 20:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227743  13 58412 73602153 A  ERRORERROR'
2018-10-21 20:26:42 [DEBUG   ] Got command RPT from MCS: ref #227744
2018-10-21 20:26:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227744  77 58412 73602357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:26:42 [DEBUG   ] Got command RPT from MCS: ref #227745
2018-10-21 20:26:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227745  12 58412 73602561 A  ERRORBš™š'
2018-10-21 20:26:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:27:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:27:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:27:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:27:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:27:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:27:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:27:24 [DEBUG   ] Finished updating board flags in 2.036 seconds
2018-10-21 20:27:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:27:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:28:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 20:28:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:28:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 20:28:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:28:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:28:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:28:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:28:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:28:24 [DEBUG   ] Finished updating board flags in 1.942 seconds
2018-10-21 20:28:28 [DEBUG   ] Got command RPT from MCS: ref #227750
2018-10-21 20:28:28 [DEBUG   ] summary = ERROR
2018-10-21 20:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227750  13 58412 73708697 A  ERRORERROR'
2018-10-21 20:28:28 [DEBUG   ] Got command RPT from MCS: ref #227751
2018-10-21 20:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227751  77 58412 73708698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:28:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:28:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:29:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:29:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:29:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:29:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:29:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:29:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:29:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:29:24 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-10-21 20:29:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:29:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:30:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:30:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:30:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 20:30:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:30:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:30:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:30:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:30:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:30:24 [DEBUG   ] Finished updating board flags in 1.743 seconds
2018-10-21 20:30:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:30:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:31:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:31:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:31:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:31:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:31:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:31:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:31:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:31:24 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-21 20:31:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:31:41 [DEBUG   ] Got command RPT from MCS: ref #227773
2018-10-21 20:31:41 [DEBUG   ] summary = ERROR
2018-10-21 20:31:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227773  13 58412 73901837 A  ERRORERROR'
2018-10-21 20:31:42 [DEBUG   ] Got command RPT from MCS: ref #227774
2018-10-21 20:31:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227774  77 58412 73902029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:31:42 [DEBUG   ] Got command RPT from MCS: ref #227775
2018-10-21 20:31:42 [DEBUG   ] summary = ERROR
2018-10-21 20:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227775  13 58412 73902233 A  ERRORERROR'
2018-10-21 20:31:42 [DEBUG   ] Got command RPT from MCS: ref #227777
2018-10-21 20:31:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227777  77 58412 73902437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:31:42 [DEBUG   ] Got command RPT from MCS: ref #227778
2018-10-21 20:31:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227778  12 58412 73902641 A  ERRORB›™š'
2018-10-21 20:31:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:32:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 20:32:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:32:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 20:32:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:32:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:32:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:32:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:32:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:32:24 [DEBUG   ] Finished updating board flags in 1.683 seconds
2018-10-21 20:32:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:32:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:33:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:33:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:33:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 20:33:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:33:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:33:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:33:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:33:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:33:24 [DEBUG   ] Finished updating board flags in 1.512 seconds
2018-10-21 20:33:28 [DEBUG   ] Got command RPT from MCS: ref #227787
2018-10-21 20:33:28 [DEBUG   ] summary = ERROR
2018-10-21 20:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227787  13 58412 74008697 A  ERRORERROR'
2018-10-21 20:33:28 [DEBUG   ] Got command RPT from MCS: ref #227788
2018-10-21 20:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227788  77 58412 74008698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:33:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 20:33:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:34:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:34:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:34:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:34:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:34:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:34:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:34:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:34:24 [DEBUG   ] Finished updating board flags in 1.487 seconds
2018-10-21 20:34:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 20:34:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 20:35:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 20:35:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:35:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 20:35:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:35:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:35:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:35:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:35:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:35:24 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-10-21 20:35:34 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-21 20:35:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:36:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:36:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:36:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:36:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:36:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:36:24 [WARNING ] (13, 1, 'bot')
2018-10-21 20:36:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:36:24 [DEBUG   ] Finished updating board flags in 1.504 seconds
2018-10-21 20:36:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:36:41 [DEBUG   ] Got command RPT from MCS: ref #227808
2018-10-21 20:36:41 [DEBUG   ] summary = ERROR
2018-10-21 20:36:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227808  13 58412 74201913 A  ERRORERROR'
2018-10-21 20:36:42 [DEBUG   ] Got command RPT from MCS: ref #227809
2018-10-21 20:36:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227809  77 58412 74202117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:36:42 [DEBUG   ] Got command RPT from MCS: ref #227810
2018-10-21 20:36:42 [DEBUG   ] summary = ERROR
2018-10-21 20:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227810  13 58412 74202321 A  ERRORERROR'
2018-10-21 20:36:42 [DEBUG   ] Got command RPT from MCS: ref #227811
2018-10-21 20:36:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227811  77 58412 74202513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:36:42 [DEBUG   ] Got command RPT from MCS: ref #227812
2018-10-21 20:36:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227812  12 58412 74202717 A  ERRORB›™š'
2018-10-21 20:36:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:37:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:37:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 20:37:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:37:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 20:37:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:37:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:37:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:37:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:37:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:37:25 [DEBUG   ] Finished updating board flags in 2.164 seconds
2018-10-21 20:37:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:37:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:38:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:38:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:38:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:38:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:38:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:38:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:38:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:38:25 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-10-21 20:38:28 [DEBUG   ] Got command RPT from MCS: ref #227813
2018-10-21 20:38:28 [DEBUG   ] summary = ERROR
2018-10-21 20:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227813  13 58412 74308697 A  ERRORERROR'
2018-10-21 20:38:28 [DEBUG   ] Got command RPT from MCS: ref #227814
2018-10-21 20:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227814  77 58412 74308698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:38:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 20:38:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:39:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:39:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:39:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:39:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:39:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:39:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:39:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:39:25 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-21 20:39:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:39:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:40:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:40:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:40:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 20:40:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:40:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:40:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:40:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:40:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:40:25 [DEBUG   ] Finished updating board flags in 1.932 seconds
2018-10-21 20:40:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:40:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 20:41:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:41:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 20:41:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:41:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 20:41:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 20:41:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:41:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:41:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:41:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:41:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:41:25 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-10-21 20:41:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:41:41 [DEBUG   ] Got command RPT from MCS: ref #227836
2018-10-21 20:41:41 [DEBUG   ] summary = ERROR
2018-10-21 20:41:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227836  13 58412 74501993 A  ERRORERROR'
2018-10-21 20:41:42 [DEBUG   ] Got command RPT from MCS: ref #227837
2018-10-21 20:41:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227837  77 58412 74502197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:41:42 [DEBUG   ] Got command RPT from MCS: ref #227838
2018-10-21 20:41:42 [DEBUG   ] summary = ERROR
2018-10-21 20:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227838  13 58412 74502401 A  ERRORERROR'
2018-10-21 20:41:42 [DEBUG   ] Got command RPT from MCS: ref #227840
2018-10-21 20:41:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227840  77 58412 74502593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:41:42 [DEBUG   ] Got command RPT from MCS: ref #227842
2018-10-21 20:41:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227842  12 58412 74502797 A  ERRORB›™š'
2018-10-21 20:41:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:42:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 20:42:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:42:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 20:42:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 20:42:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:42:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:42:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:42:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:42:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:42:25 [DEBUG   ] Finished updating board flags in 1.757 seconds
2018-10-21 20:42:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 20:42:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:43:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:43:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:43:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:43:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:43:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:43:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:43:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:43:25 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-10-21 20:43:28 [DEBUG   ] Got command RPT from MCS: ref #227850
2018-10-21 20:43:28 [DEBUG   ] summary = ERROR
2018-10-21 20:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227850  13 58412 74608697 A  ERRORERROR'
2018-10-21 20:43:28 [DEBUG   ] Got command RPT from MCS: ref #227851
2018-10-21 20:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227851  77 58412 74608698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:43:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 20:43:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:44:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 20:44:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 20:44:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:44:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 20:44:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 20:44:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:44:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:44:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:44:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:44:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:44:25 [DEBUG   ] Finished updating board flags in 1.640 seconds
2018-10-21 20:44:34 [DEBUG   ] Finished updating ant stats in 0.785 seconds
2018-10-21 20:44:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:45:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 20:45:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:45:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:45:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:45:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:45:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:45:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:45:25 [DEBUG   ] Finished updating board flags in 1.645 seconds
2018-10-21 20:45:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 20:45:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:46:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:46:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 20:46:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:46:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:46:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:46:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:46:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:46:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:46:25 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-10-21 20:46:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 20:46:42 [DEBUG   ] Got command RPT from MCS: ref #227871
2018-10-21 20:46:42 [DEBUG   ] summary = ERROR
2018-10-21 20:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227871  13 58412 74802081 A  ERRORERROR'
2018-10-21 20:46:42 [DEBUG   ] Got command RPT from MCS: ref #227872
2018-10-21 20:46:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227872  77 58412 74802285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:46:42 [DEBUG   ] Got command RPT from MCS: ref #227873
2018-10-21 20:46:42 [DEBUG   ] summary = ERROR
2018-10-21 20:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227873  13 58412 74802477 A  ERRORERROR'
2018-10-21 20:46:42 [DEBUG   ] Got command RPT from MCS: ref #227874
2018-10-21 20:46:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227874  77 58412 74802681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:46:42 [DEBUG   ] Got command RPT from MCS: ref #227875
2018-10-21 20:46:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227875  12 58412 74802885 A  ERRORBš™š'
2018-10-21 20:46:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 20:47:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:47:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:47:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:47:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:47:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:47:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:47:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:47:25 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-21 20:47:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 20:47:54 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-21 20:48:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 20:48:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 20:48:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:48:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 20:48:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 20:48:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:48:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:48:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:48:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:48:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:48:25 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-10-21 20:48:28 [DEBUG   ] Got command RPT from MCS: ref #227880
2018-10-21 20:48:28 [DEBUG   ] summary = ERROR
2018-10-21 20:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227880  13 58412 74908693 A  ERRORERROR'
2018-10-21 20:48:28 [DEBUG   ] Got command RPT from MCS: ref #227881
2018-10-21 20:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227881  77 58412 74908694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:48:34 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 20:48:54 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 20:49:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 20:49:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:49:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:49:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:49:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:49:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:49:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:49:25 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-10-21 20:49:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 20:49:54 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 20:50:15 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-21 20:50:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 20:50:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:50:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:50:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:50:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:50:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:50:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:50:25 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-21 20:50:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-21 20:50:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:51:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:51:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:51:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:51:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:51:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:51:25 [WARNING ] (13, 1, 'bot')
2018-10-21 20:51:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:51:25 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-10-21 20:51:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:51:42 [DEBUG   ] Got command RPT from MCS: ref #227903
2018-10-21 20:51:42 [DEBUG   ] summary = ERROR
2018-10-21 20:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227903  13 58412 75102161 A  ERRORERROR'
2018-10-21 20:51:42 [DEBUG   ] Got command RPT from MCS: ref #227904
2018-10-21 20:51:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227904  77 58412 75102353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:51:42 [DEBUG   ] Got command RPT from MCS: ref #227905
2018-10-21 20:51:42 [DEBUG   ] summary = ERROR
2018-10-21 20:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227905  13 58412 75102557 A  ERRORERROR'
2018-10-21 20:51:42 [DEBUG   ] Got command RPT from MCS: ref #227907
2018-10-21 20:51:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227907  77 58412 75102761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:51:42 [DEBUG   ] Got command RPT from MCS: ref #227909
2018-10-21 20:51:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:51:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227909  12 58412 75102965 A  ERRORB›™š'
2018-10-21 20:51:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:52:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:52:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:52:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:52:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:52:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:52:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:52:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:52:26 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-10-21 20:52:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:52:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:53:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:53:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:53:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:53:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:53:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:53:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:53:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:53:26 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-10-21 20:53:28 [DEBUG   ] Got command RPT from MCS: ref #227913
2018-10-21 20:53:28 [DEBUG   ] summary = ERROR
2018-10-21 20:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227913  13 58412 75208697 A  ERRORERROR'
2018-10-21 20:53:28 [DEBUG   ] Got command RPT from MCS: ref #227914
2018-10-21 20:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227914  77 58412 75208698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:53:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:53:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:54:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:54:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:54:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 20:54:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 20:54:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:54:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:54:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:54:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:54:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:54:26 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-10-21 20:54:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:54:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:55:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:55:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:55:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 20:55:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 20:55:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:55:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:55:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:55:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:55:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:55:26 [DEBUG   ] Finished updating board flags in 2.098 seconds
2018-10-21 20:55:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:55:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:56:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:56:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:56:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:56:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:56:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:56:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:56:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:56:26 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-10-21 20:56:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:56:42 [DEBUG   ] Got command RPT from MCS: ref #227934
2018-10-21 20:56:42 [DEBUG   ] summary = ERROR
2018-10-21 20:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227934  13 58412 75402233 A  ERRORERROR'
2018-10-21 20:56:42 [DEBUG   ] Got command RPT from MCS: ref #227935
2018-10-21 20:56:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227935  77 58412 75402437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:56:42 [DEBUG   ] Got command RPT from MCS: ref #227936
2018-10-21 20:56:42 [DEBUG   ] summary = ERROR
2018-10-21 20:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227936  13 58412 75402641 A  ERRORERROR'
2018-10-21 20:56:42 [DEBUG   ] Got command RPT from MCS: ref #227937
2018-10-21 20:56:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:56:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227937  77 58412 75402845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:56:43 [DEBUG   ] Got command RPT from MCS: ref #227938
2018-10-21 20:56:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 20:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227938  12 58412 75403037 A  ERRORBš™š'
2018-10-21 20:56:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:57:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:57:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:57:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:57:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:57:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:57:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:57:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:57:26 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-10-21 20:57:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:57:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:58:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 20:58:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:58:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:58:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:58:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:58:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:58:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:58:26 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-10-21 20:58:28 [DEBUG   ] Got command RPT from MCS: ref #227943
2018-10-21 20:58:28 [DEBUG   ] summary = ERROR
2018-10-21 20:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227943  13 58412 75508697 A  ERRORERROR'
2018-10-21 20:58:28 [DEBUG   ] Got command RPT from MCS: ref #227944
2018-10-21 20:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 20:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227944  77 58412 75508698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 20:58:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 20:58:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:59:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 20:59:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 20:59:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 20:59:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:59:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:59:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:59:26 [WARNING ] (13, 1, 'bot')
2018-10-21 20:59:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 20:59:26 [DEBUG   ] Finished updating board flags in 1.856 seconds
2018-10-21 20:59:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 20:59:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 21:00:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 21:00:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 21:00:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:00:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 21:00:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:00:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:00:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:00:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:00:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:00:26 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-10-21 21:00:35 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2018-10-21 21:00:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 21:01:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 21:01:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:01:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:01:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:01:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:01:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:01:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:01:26 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-10-21 21:01:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 21:01:42 [DEBUG   ] Got command RPT from MCS: ref #227966
2018-10-21 21:01:42 [DEBUG   ] summary = ERROR
2018-10-21 21:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227966  13 58412 75702325 A  ERRORERROR'
2018-10-21 21:01:42 [DEBUG   ] Got command RPT from MCS: ref #227967
2018-10-21 21:01:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227967  77 58412 75702517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:01:42 [DEBUG   ] Got command RPT from MCS: ref #227968
2018-10-21 21:01:42 [DEBUG   ] summary = ERROR
2018-10-21 21:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227968  13 58412 75702721 A  ERRORERROR'
2018-10-21 21:01:42 [DEBUG   ] Got command RPT from MCS: ref #227970
2018-10-21 21:01:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:01:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227970  77 58412 75702925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:01:43 [DEBUG   ] Got command RPT from MCS: ref #227972
2018-10-21 21:01:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227972  12 58412 75703129 A  ERRORB›™š'
2018-10-21 21:01:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 21:02:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 21:02:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:02:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:02:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:02:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:02:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:02:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:02:26 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-10-21 21:02:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 21:02:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:03:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:03:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:03:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 21:03:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:03:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:03:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:03:26 [WARNING ] (13, 1, 'bot')
2018-10-21 21:03:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:03:26 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-21 21:03:28 [DEBUG   ] Got command RPT from MCS: ref #227980
2018-10-21 21:03:28 [DEBUG   ] summary = ERROR
2018-10-21 21:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227980  13 58412 75808697 A  ERRORERROR'
2018-10-21 21:03:28 [DEBUG   ] Got command RPT from MCS: ref #227981
2018-10-21 21:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   227981  77 58412 75808698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:03:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:03:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:04:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:04:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:04:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:04:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:04:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:04:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:04:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:04:27 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-10-21 21:04:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:04:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:05:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:05:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:05:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:05:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:05:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:05:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:05:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:05:27 [DEBUG   ] Finished updating board flags in 2.080 seconds
2018-10-21 21:05:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:05:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:06:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:06:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 21:06:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:06:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:06:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:06:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:06:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:06:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:06:27 [DEBUG   ] Finished updating board flags in 1.897 seconds
2018-10-21 21:06:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:06:42 [DEBUG   ] Got command RPT from MCS: ref #228001
2018-10-21 21:06:42 [DEBUG   ] summary = ERROR
2018-10-21 21:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228001  13 58412 76002409 A  ERRORERROR'
2018-10-21 21:06:42 [DEBUG   ] Got command RPT from MCS: ref #228002
2018-10-21 21:06:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228002  77 58412 76002601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:06:42 [DEBUG   ] Got command RPT from MCS: ref #228003
2018-10-21 21:06:42 [DEBUG   ] summary = ERROR
2018-10-21 21:06:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228003  13 58412 76002805 A  ERRORERROR'
2018-10-21 21:06:43 [DEBUG   ] Got command RPT from MCS: ref #228004
2018-10-21 21:06:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228004  77 58412 76003009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:06:43 [DEBUG   ] Got command RPT from MCS: ref #228005
2018-10-21 21:06:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228005  12 58412 76003201 A  ERRORB›™š'
2018-10-21 21:06:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:07:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:07:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:07:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:07:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:07:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:07:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:07:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:07:27 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-21 21:07:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:07:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:08:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 21:08:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:08:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:08:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:08:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:08:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:08:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:08:27 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-21 21:08:28 [DEBUG   ] Got command RPT from MCS: ref #228006
2018-10-21 21:08:28 [DEBUG   ] summary = ERROR
2018-10-21 21:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228006  13 58412 76108697 A  ERRORERROR'
2018-10-21 21:08:28 [DEBUG   ] Got command RPT from MCS: ref #228007
2018-10-21 21:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228007  77 58412 76108698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:08:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:08:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:09:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:09:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:09:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:09:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:09:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:09:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:09:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:09:27 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-10-21 21:09:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 21:09:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:10:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 21:10:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:10:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 21:10:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 21:10:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:10:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:10:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:10:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:10:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:10:27 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-10-21 21:10:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 21:10:55 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 21:11:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 21:11:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:11:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 21:11:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:11:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:11:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:11:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:11:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:11:27 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-10-21 21:11:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 21:11:42 [DEBUG   ] Got command RPT from MCS: ref #228029
2018-10-21 21:11:42 [DEBUG   ] summary = ERROR
2018-10-21 21:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228029  13 58412 76302489 A  ERRORERROR'
2018-10-21 21:11:42 [DEBUG   ] Got command RPT from MCS: ref #228030
2018-10-21 21:11:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228030  77 58412 76302681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:11:42 [DEBUG   ] Got command RPT from MCS: ref #228031
2018-10-21 21:11:42 [DEBUG   ] summary = ERROR
2018-10-21 21:11:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228031  13 58412 76302885 A  ERRORERROR'
2018-10-21 21:11:43 [DEBUG   ] Got command RPT from MCS: ref #228033
2018-10-21 21:11:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228033  77 58412 76303089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:11:43 [DEBUG   ] Got command RPT from MCS: ref #228034
2018-10-21 21:11:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228034  12 58412 76303293 A  ERRORB›™š'
2018-10-21 21:11:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 21:12:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 21:12:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:12:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 21:12:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:12:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:12:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:12:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:12:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:12:27 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-21 21:12:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 21:12:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 21:13:16 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-21 21:13:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:13:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:13:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:13:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:13:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:13:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:13:27 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-10-21 21:13:28 [DEBUG   ] Got command RPT from MCS: ref #228043
2018-10-21 21:13:28 [DEBUG   ] summary = ERROR
2018-10-21 21:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228043  13 58412 76408701 A  ERRORERROR'
2018-10-21 21:13:28 [DEBUG   ] Got command RPT from MCS: ref #228044
2018-10-21 21:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228044  77 58412 76408702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:13:36 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-21 21:13:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:14:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:14:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 21:14:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:14:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:14:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:14:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:14:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:14:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:14:27 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-21 21:14:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:14:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:15:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:15:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:15:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 21:15:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:15:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:15:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:15:27 [WARNING ] (13, 1, 'bot')
2018-10-21 21:15:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:15:27 [DEBUG   ] Finished updating board flags in 1.553 seconds
2018-10-21 21:15:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:15:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:16:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:16:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:16:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:16:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:16:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:16:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:16:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:16:28 [DEBUG   ] Finished updating board flags in 2.306 seconds
2018-10-21 21:16:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:16:42 [DEBUG   ] Got command RPT from MCS: ref #228064
2018-10-21 21:16:42 [DEBUG   ] summary = ERROR
2018-10-21 21:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228064  13 58412 76602569 A  ERRORERROR'
2018-10-21 21:16:42 [DEBUG   ] Got command RPT from MCS: ref #228065
2018-10-21 21:16:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228065  77 58412 76602761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:16:42 [DEBUG   ] Got command RPT from MCS: ref #228066
2018-10-21 21:16:42 [DEBUG   ] summary = ERROR
2018-10-21 21:16:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228066  13 58412 76602965 A  ERRORERROR'
2018-10-21 21:16:43 [DEBUG   ] Got command RPT from MCS: ref #228067
2018-10-21 21:16:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228067  77 58412 76603169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:16:43 [DEBUG   ] Got command RPT from MCS: ref #228068
2018-10-21 21:16:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228068  12 58412 76603373 A  ERRORB›™š'
2018-10-21 21:16:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:17:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:17:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:17:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:17:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:17:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:17:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:17:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:17:28 [DEBUG   ] Finished updating board flags in 2.083 seconds
2018-10-21 21:17:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:17:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:18:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:18:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:18:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 21:18:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:18:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:18:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:18:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:18:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:18:28 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-10-21 21:18:28 [DEBUG   ] Got command RPT from MCS: ref #228073
2018-10-21 21:18:28 [DEBUG   ] summary = ERROR
2018-10-21 21:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228073  13 58412 76708697 A  ERRORERROR'
2018-10-21 21:18:28 [DEBUG   ] Got command RPT from MCS: ref #228074
2018-10-21 21:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228074  77 58412 76708698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:18:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:18:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:19:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:19:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:19:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:19:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:19:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:19:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:19:28 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-21 21:19:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:19:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:20:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:20:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 21:20:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:20:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:20:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:20:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:20:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:20:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:20:28 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-10-21 21:20:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:20:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:21:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:21:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 21:21:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:21:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 21:21:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:21:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:21:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:21:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:21:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:21:28 [DEBUG   ] Finished updating board flags in 1.915 seconds
2018-10-21 21:21:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:21:42 [DEBUG   ] Got command RPT from MCS: ref #228096
2018-10-21 21:21:42 [DEBUG   ] summary = ERROR
2018-10-21 21:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228096  13 58412 76902649 A  ERRORERROR'
2018-10-21 21:21:42 [DEBUG   ] Got command RPT from MCS: ref #228097
2018-10-21 21:21:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:21:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228097  77 58412 76902853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:21:43 [DEBUG   ] Got command RPT from MCS: ref #228098
2018-10-21 21:21:43 [DEBUG   ] summary = ERROR
2018-10-21 21:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228098  13 58412 76903045 A  ERRORERROR'
2018-10-21 21:21:43 [DEBUG   ] Got command RPT from MCS: ref #228100
2018-10-21 21:21:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228100  77 58412 76903249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:21:43 [DEBUG   ] Got command RPT from MCS: ref #228101
2018-10-21 21:21:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228101  12 58412 76903453 A  ERRORB›™š'
2018-10-21 21:21:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:22:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:22:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:22:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:22:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:22:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:22:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:22:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:22:28 [DEBUG   ] Finished updating board flags in 1.712 seconds
2018-10-21 21:22:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:22:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:23:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:23:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 21:23:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:23:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 21:23:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:23:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:23:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:23:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:23:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:23:28 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-21 21:23:28 [DEBUG   ] Got command RPT from MCS: ref #228106
2018-10-21 21:23:28 [DEBUG   ] summary = ERROR
2018-10-21 21:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228106  13 58412 77008709 A  ERRORERROR'
2018-10-21 21:23:28 [DEBUG   ] Got command RPT from MCS: ref #228107
2018-10-21 21:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228107  77 58412 77008710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:23:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:23:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:24:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:24:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:24:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:24:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:24:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:24:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:24:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:24:28 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-10-21 21:24:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:24:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:25:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:25:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:25:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:25:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:25:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:25:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:25:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:25:28 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-10-21 21:25:36 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-21 21:25:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:26:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:26:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:26:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 21:26:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 21:26:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:26:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:26:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:26:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:26:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:26:28 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-21 21:26:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:26:42 [DEBUG   ] Got command RPT from MCS: ref #228127
2018-10-21 21:26:42 [DEBUG   ] summary = ERROR
2018-10-21 21:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228127  13 58412 77202725 A  ERRORERROR'
2018-10-21 21:26:42 [DEBUG   ] Got command RPT from MCS: ref #228128
2018-10-21 21:26:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228128  77 58412 77202929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:26:43 [DEBUG   ] Got command RPT from MCS: ref #228129
2018-10-21 21:26:43 [DEBUG   ] summary = ERROR
2018-10-21 21:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228129  13 58412 77203133 A  ERRORERROR'
2018-10-21 21:26:43 [DEBUG   ] Got command RPT from MCS: ref #228130
2018-10-21 21:26:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228130  77 58412 77203325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:26:43 [DEBUG   ] Got command RPT from MCS: ref #228131
2018-10-21 21:26:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228131  12 58412 77203529 A  ERRORB›™š'
2018-10-21 21:26:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:27:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:27:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:27:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:27:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:27:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:27:28 [WARNING ] (13, 1, 'bot')
2018-10-21 21:27:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:27:28 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-10-21 21:27:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:27:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:28:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:28:28 [DEBUG   ] Got command RPT from MCS: ref #228136
2018-10-21 21:28:28 [DEBUG   ] summary = ERROR
2018-10-21 21:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228136  13 58412 77308710 A  ERRORERROR'
2018-10-21 21:28:28 [DEBUG   ] Got command RPT from MCS: ref #228137
2018-10-21 21:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228137  77 58412 77308710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:28:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:28:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:28:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:28:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:28:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:28:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:28:29 [DEBUG   ] Finished updating board flags in 2.174 seconds
2018-10-21 21:28:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:28:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:29:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:29:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:29:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:29:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:29:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:29:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:29:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:29:29 [DEBUG   ] Finished updating board flags in 1.928 seconds
2018-10-21 21:29:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:29:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:30:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:30:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:30:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:30:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:30:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:30:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:30:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:30:29 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-10-21 21:30:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:30:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:31:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:31:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:31:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 21:31:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:31:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:31:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:31:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:31:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:31:29 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-10-21 21:31:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:31:42 [DEBUG   ] Got command RPT from MCS: ref #228159
2018-10-21 21:31:42 [DEBUG   ] summary = ERROR
2018-10-21 21:31:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228159  13 58412 77502805 A  ERRORERROR'
2018-10-21 21:31:43 [DEBUG   ] Got command RPT from MCS: ref #228160
2018-10-21 21:31:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228160  77 58412 77503009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:31:43 [DEBUG   ] Got command RPT from MCS: ref #228161
2018-10-21 21:31:43 [DEBUG   ] summary = ERROR
2018-10-21 21:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228161  13 58412 77503213 A  ERRORERROR'
2018-10-21 21:31:43 [DEBUG   ] Got command RPT from MCS: ref #228163
2018-10-21 21:31:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228163  77 58412 77503405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:31:43 [DEBUG   ] Got command RPT from MCS: ref #228165
2018-10-21 21:31:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228165  12 58412 77503609 A  ERRORB›™š'
2018-10-21 21:31:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:32:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:32:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:32:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 21:32:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:32:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:32:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:32:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:32:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:32:29 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-10-21 21:32:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:32:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:33:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:33:28 [DEBUG   ] Got command RPT from MCS: ref #228173
2018-10-21 21:33:28 [DEBUG   ] summary = ERROR
2018-10-21 21:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228173  13 58412 77608709 A  ERRORERROR'
2018-10-21 21:33:28 [DEBUG   ] Got command RPT from MCS: ref #228174
2018-10-21 21:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228174  77 58412 77608710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:33:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:33:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:33:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:33:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:33:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:33:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:33:29 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-10-21 21:33:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:33:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:34:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:34:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:34:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 21:34:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:34:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:34:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:34:29 [WARNING ] (13, 1, 'bot')
2018-10-21 21:34:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:34:29 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-10-21 21:34:36 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-21 21:34:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 21:35:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 21:35:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 21:35:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:35:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:35:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:35:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:35:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:35:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:35:30 [DEBUG   ] Finished updating board flags in 2.232 seconds
2018-10-21 21:35:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 21:35:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 21:36:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-21 21:36:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 21:36:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:36:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 21:36:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 21:36:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:36:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:36:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:36:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:36:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:36:30 [DEBUG   ] Finished updating board flags in 2.095 seconds
2018-10-21 21:36:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 21:36:42 [DEBUG   ] Got command RPT from MCS: ref #228194
2018-10-21 21:36:42 [DEBUG   ] summary = ERROR
2018-10-21 21:36:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228194  13 58412 77802889 A  ERRORERROR'
2018-10-21 21:36:43 [DEBUG   ] Got command RPT from MCS: ref #228195
2018-10-21 21:36:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228195  77 58412 77803093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:36:43 [DEBUG   ] Got command RPT from MCS: ref #228196
2018-10-21 21:36:43 [DEBUG   ] summary = ERROR
2018-10-21 21:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228196  13 58412 77803285 A  ERRORERROR'
2018-10-21 21:36:43 [DEBUG   ] Got command RPT from MCS: ref #228197
2018-10-21 21:36:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228197  77 58412 77803489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:36:43 [DEBUG   ] Got command RPT from MCS: ref #228198
2018-10-21 21:36:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228198  12 58412 77803693 A  ERRORB›™š'
2018-10-21 21:36:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 21:37:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 21:37:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:37:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:37:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:37:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:37:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:37:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:37:30 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-10-21 21:37:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 21:37:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 21:38:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 21:38:28 [DEBUG   ] Got command RPT from MCS: ref #228199
2018-10-21 21:38:28 [DEBUG   ] summary = ERROR
2018-10-21 21:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228199  13 58412 77908713 A  ERRORERROR'
2018-10-21 21:38:28 [DEBUG   ] Got command RPT from MCS: ref #228200
2018-10-21 21:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228200  77 58412 77908714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:38:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:38:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 21:38:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 21:38:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 21:38:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:38:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:38:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:38:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:38:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:38:30 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-10-21 21:38:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 21:38:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 21:39:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 21:39:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:39:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 21:39:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 21:39:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:39:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:39:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:39:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:39:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:39:30 [DEBUG   ] Finished updating board flags in 1.837 seconds
2018-10-21 21:39:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 21:39:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 21:40:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 21:40:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:40:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:40:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:40:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:40:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:40:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:40:30 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-10-21 21:40:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 21:40:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 21:41:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 21:41:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 21:41:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:41:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:41:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:41:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:41:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:41:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:41:30 [DEBUG   ] Finished updating board flags in 1.707 seconds
2018-10-21 21:41:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 21:41:42 [DEBUG   ] Got command RPT from MCS: ref #228222
2018-10-21 21:41:42 [DEBUG   ] summary = ERROR
2018-10-21 21:41:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228222  13 58412 78102965 A  ERRORERROR'
2018-10-21 21:41:43 [DEBUG   ] Got command RPT from MCS: ref #228223
2018-10-21 21:41:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228223  77 58412 78103169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:41:43 [DEBUG   ] Got command RPT from MCS: ref #228224
2018-10-21 21:41:43 [DEBUG   ] summary = ERROR
2018-10-21 21:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228224  13 58412 78103361 A  ERRORERROR'
2018-10-21 21:41:43 [DEBUG   ] Got command RPT from MCS: ref #228226
2018-10-21 21:41:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228226  77 58412 78103565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:41:43 [DEBUG   ] Got command RPT from MCS: ref #228228
2018-10-21 21:41:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228228  12 58412 78103769 A  ERRORB›™š'
2018-10-21 21:41:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 21:42:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 21:42:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 21:42:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:42:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:42:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:42:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:42:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:42:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:42:30 [DEBUG   ] Finished updating board flags in 1.532 seconds
2018-10-21 21:42:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 21:42:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 21:43:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 21:43:28 [DEBUG   ] Got command RPT from MCS: ref #228236
2018-10-21 21:43:28 [DEBUG   ] summary = ERROR
2018-10-21 21:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228236  13 58412 78208705 A  ERRORERROR'
2018-10-21 21:43:28 [DEBUG   ] Got command RPT from MCS: ref #228237
2018-10-21 21:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228237  77 58412 78208706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:43:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:43:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 21:43:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:43:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:43:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:43:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:43:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:43:30 [DEBUG   ] Finished updating board flags in 1.544 seconds
2018-10-21 21:43:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 21:43:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 21:44:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 21:44:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:44:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:44:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:44:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:44:30 [WARNING ] (13, 1, 'bot')
2018-10-21 21:44:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:44:30 [DEBUG   ] Finished updating board flags in 1.528 seconds
2018-10-21 21:44:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 21:44:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 21:45:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 21:45:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:45:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:45:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:45:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:45:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:45:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:45:31 [DEBUG   ] Finished updating board flags in 2.150 seconds
2018-10-21 21:45:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 21:45:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 21:46:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 21:46:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:46:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 21:46:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:46:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:46:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:46:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:46:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:46:31 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-10-21 21:46:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 21:46:43 [DEBUG   ] Got command RPT from MCS: ref #228257
2018-10-21 21:46:43 [DEBUG   ] summary = ERROR
2018-10-21 21:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228257  13 58412 78403045 A  ERRORERROR'
2018-10-21 21:46:43 [DEBUG   ] Got command RPT from MCS: ref #228258
2018-10-21 21:46:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228258  77 58412 78403249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:46:43 [DEBUG   ] Got command RPT from MCS: ref #228259
2018-10-21 21:46:43 [DEBUG   ] summary = ERROR
2018-10-21 21:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228259  13 58412 78403453 A  ERRORERROR'
2018-10-21 21:46:43 [DEBUG   ] Got command RPT from MCS: ref #228260
2018-10-21 21:46:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228260  77 58412 78403645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:46:43 [DEBUG   ] Got command RPT from MCS: ref #228261
2018-10-21 21:46:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228261  12 58412 78403849 A  ERRORB›™š'
2018-10-21 21:46:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 21:47:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 21:47:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:47:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:47:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:47:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:47:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:47:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:47:31 [DEBUG   ] Finished updating board flags in 1.874 seconds
2018-10-21 21:47:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 21:47:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 21:48:17 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2018-10-21 21:48:28 [DEBUG   ] Got command RPT from MCS: ref #228266
2018-10-21 21:48:28 [DEBUG   ] summary = ERROR
2018-10-21 21:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228266  13 58412 78508709 A  ERRORERROR'
2018-10-21 21:48:28 [DEBUG   ] Got command RPT from MCS: ref #228267
2018-10-21 21:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228267  77 58412 78508710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:48:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:48:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 21:48:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:48:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:48:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:48:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:48:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:48:31 [DEBUG   ] Finished updating board flags in 1.702 seconds
2018-10-21 21:48:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:48:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:49:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:49:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:49:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:49:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:49:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:49:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:49:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:49:31 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-21 21:49:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 21:49:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:50:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:50:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:50:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 21:50:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:50:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:50:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:50:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:50:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:50:31 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-10-21 21:50:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:50:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:51:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:51:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:51:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:51:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:51:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:51:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:51:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:51:31 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-10-21 21:51:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:51:43 [DEBUG   ] Got command RPT from MCS: ref #228289
2018-10-21 21:51:43 [DEBUG   ] summary = ERROR
2018-10-21 21:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228289  13 58412 78703125 A  ERRORERROR'
2018-10-21 21:51:43 [DEBUG   ] Got command RPT from MCS: ref #228290
2018-10-21 21:51:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228290  77 58412 78703329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:51:43 [DEBUG   ] Got command RPT from MCS: ref #228291
2018-10-21 21:51:43 [DEBUG   ] summary = ERROR
2018-10-21 21:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228291  13 58412 78703521 A  ERRORERROR'
2018-10-21 21:51:43 [DEBUG   ] Got command RPT from MCS: ref #228293
2018-10-21 21:51:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228293  77 58412 78703725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:51:43 [DEBUG   ] Got command RPT from MCS: ref #228294
2018-10-21 21:51:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228294  12 58412 78703929 A  ERRORB›™š'
2018-10-21 21:51:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:52:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 21:52:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:52:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 21:52:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:52:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:52:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:52:31 [WARNING ] (13, 1, 'bot')
2018-10-21 21:52:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:52:31 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-10-21 21:52:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:52:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 21:53:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 21:53:28 [DEBUG   ] Got command RPT from MCS: ref #228299
2018-10-21 21:53:28 [DEBUG   ] summary = ERROR
2018-10-21 21:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228299  13 58412 78808705 A  ERRORERROR'
2018-10-21 21:53:28 [DEBUG   ] Got command RPT from MCS: ref #228300
2018-10-21 21:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228300  77 58412 78808706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:53:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:53:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:53:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:53:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:53:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:53:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:53:32 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-21 21:53:37 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-21 21:53:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:54:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:54:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:54:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:54:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:54:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:54:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:54:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:54:32 [DEBUG   ] Finished updating board flags in 2.152 seconds
2018-10-21 21:54:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:54:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:55:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:55:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:55:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:55:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:55:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:55:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:55:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:55:32 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-21 21:55:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:55:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:56:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:56:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 21:56:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:56:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:56:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:56:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:56:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:56:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:56:32 [DEBUG   ] Finished updating board flags in 1.877 seconds
2018-10-21 21:56:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:56:43 [DEBUG   ] Got command RPT from MCS: ref #228320
2018-10-21 21:56:43 [DEBUG   ] summary = ERROR
2018-10-21 21:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228320  13 58412 79003209 A  ERRORERROR'
2018-10-21 21:56:43 [DEBUG   ] Got command RPT from MCS: ref #228321
2018-10-21 21:56:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228321  77 58412 79003401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:56:43 [DEBUG   ] Got command RPT from MCS: ref #228322
2018-10-21 21:56:43 [DEBUG   ] summary = ERROR
2018-10-21 21:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228322  13 58412 79003605 A  ERRORERROR'
2018-10-21 21:56:43 [DEBUG   ] Got command RPT from MCS: ref #228323
2018-10-21 21:56:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228323  77 58412 79003809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:56:44 [DEBUG   ] Got command RPT from MCS: ref #228324
2018-10-21 21:56:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 21:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228324  12 58412 79004001 A  ERRORB›™š'
2018-10-21 21:56:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:57:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:57:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 21:57:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:57:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 21:57:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:57:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:57:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:57:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:57:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:57:32 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-10-21 21:57:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:57:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:58:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:58:28 [DEBUG   ] Got command RPT from MCS: ref #228329
2018-10-21 21:58:28 [DEBUG   ] summary = ERROR
2018-10-21 21:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228329  13 58412 79108705 A  ERRORERROR'
2018-10-21 21:58:28 [DEBUG   ] Got command RPT from MCS: ref #228330
2018-10-21 21:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 21:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228330  77 58412 79108706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 21:58:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:58:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:58:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:58:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:58:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:58:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:58:32 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-21 21:58:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:58:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 21:59:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 21:59:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 21:59:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 21:59:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:59:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:59:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:59:32 [WARNING ] (13, 1, 'bot')
2018-10-21 21:59:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 21:59:32 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-10-21 21:59:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 21:59:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 22:00:11 [DEBUG   ] Got command TBW from MCS: ref #228351
2018-10-21 22:00:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-21 22:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   228351   8 58412 79211342 A  ERROR'
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-21 22:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-21 22:00:14 [DEBUG   ] spawn_process: at 2018-10-21 22:00:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-21 22:00:14 [INFO    ] Finished spawning TBW
2018-10-21 22:00:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 22:00:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:00:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:00:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:00:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:00:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:00:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:00:32 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-10-21 22:01:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:01:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:01:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:01:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:01:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:01:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:01:32 [DEBUG   ] Finished updating board flags in 1.316 seconds
2018-10-21 22:01:43 [DEBUG   ] Got command RPT from MCS: ref #228358
2018-10-21 22:01:43 [DEBUG   ] summary = ERROR
2018-10-21 22:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228358  13 58412 79303289 A  ERRORERROR'
2018-10-21 22:01:43 [DEBUG   ] Got command RPT from MCS: ref #228359
2018-10-21 22:01:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228359  77 58412 79303481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:01:43 [DEBUG   ] Got command RPT from MCS: ref #228360
2018-10-21 22:01:43 [DEBUG   ] summary = ERROR
2018-10-21 22:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228360  13 58412 79303685 A  ERRORERROR'
2018-10-21 22:01:43 [DEBUG   ] Got command RPT from MCS: ref #228362
2018-10-21 22:01:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228362  77 58412 79303889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:01:44 [DEBUG   ] Got command RPT from MCS: ref #228364
2018-10-21 22:01:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228364  12 58412 79304093 A  ERRORB›™š'
2018-10-21 22:02:02 [INFO    ] __waitForTBW - TBW finished in 108.054 s
2018-10-21 22:02:03 [DEBUG   ] Finished updating ant stats in 0.363 seconds
2018-10-21 22:02:03 [INFO    ] Started antennas statistics background thread
2018-10-21 22:02:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540159325']
2018-10-21 22:02:03 [DEBUG   ] spawn_process: at 2018-10-21 22:02:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540159325']
2018-10-21 22:02:03 [INFO    ] Finished spawning TBN in 0.049 s
2018-10-21 22:02:24 [DEBUG   ] Finished updating ant stats in 1.269 seconds
2018-10-21 22:02:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:02:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 22:02:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:02:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:02:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:02:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:02:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:02:32 [DEBUG   ] Finished updating board flags in 1.529 seconds
2018-10-21 22:02:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:03:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:03:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:03:28 [DEBUG   ] Got command RPT from MCS: ref #228375
2018-10-21 22:03:28 [DEBUG   ] summary = ERROR
2018-10-21 22:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228375  13 58412 79408709 A  ERRORERROR'
2018-10-21 22:03:28 [DEBUG   ] Got command RPT from MCS: ref #228376
2018-10-21 22:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228376  77 58412 79408710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:03:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:03:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:03:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:03:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:03:32 [WARNING ] (13, 1, 'bot')
2018-10-21 22:03:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:03:32 [DEBUG   ] Finished updating board flags in 1.525 seconds
2018-10-21 22:03:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:04:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:04:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:04:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:04:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:04:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:04:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:04:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:04:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:04:33 [DEBUG   ] Finished updating board flags in 2.124 seconds
2018-10-21 22:04:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:05:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:05:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:05:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:05:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 22:05:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:05:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:05:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:05:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:05:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:05:33 [DEBUG   ] Finished updating board flags in 2.112 seconds
2018-10-21 22:05:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:06:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:06:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:06:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:06:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:06:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:06:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:06:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:06:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:06:33 [DEBUG   ] Finished updating board flags in 1.864 seconds
2018-10-21 22:06:43 [DEBUG   ] Got command RPT from MCS: ref #228396
2018-10-21 22:06:43 [DEBUG   ] summary = ERROR
2018-10-21 22:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228396  13 58412 79603365 A  ERRORERROR'
2018-10-21 22:06:43 [DEBUG   ] Got command RPT from MCS: ref #228397
2018-10-21 22:06:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228397  77 58412 79603561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:06:43 [DEBUG   ] Got command RPT from MCS: ref #228398
2018-10-21 22:06:43 [DEBUG   ] summary = ERROR
2018-10-21 22:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228398  13 58412 79603765 A  ERRORERROR'
2018-10-21 22:06:43 [DEBUG   ] Got command RPT from MCS: ref #228399
2018-10-21 22:06:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228399  77 58412 79603969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:06:44 [DEBUG   ] Got command RPT from MCS: ref #228400
2018-10-21 22:06:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228400  12 58412 79604173 A  ERRORB›™š'
2018-10-21 22:06:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:07:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:07:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:07:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:07:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:07:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:07:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:07:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:07:33 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-21 22:07:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:08:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:08:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:08:28 [DEBUG   ] Got command RPT from MCS: ref #228401
2018-10-21 22:08:28 [DEBUG   ] summary = ERROR
2018-10-21 22:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228401  13 58412 79708709 A  ERRORERROR'
2018-10-21 22:08:28 [DEBUG   ] Got command RPT from MCS: ref #228402
2018-10-21 22:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228402  77 58412 79708710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:08:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:08:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:08:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:08:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:08:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:08:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:08:33 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-21 22:08:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:09:04 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-21 22:09:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 22:09:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:09:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:09:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:09:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:09:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:09:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:09:33 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-21 22:09:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 22:10:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 22:10:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 22:10:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:10:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:10:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:10:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:10:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:10:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:10:33 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-21 22:10:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 22:11:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 22:11:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 22:11:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:11:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:11:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:11:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:11:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:11:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:11:33 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-10-21 22:11:43 [DEBUG   ] Got command RPT from MCS: ref #228424
2018-10-21 22:11:43 [DEBUG   ] summary = ERROR
2018-10-21 22:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228424  13 58412 79903441 A  ERRORERROR'
2018-10-21 22:11:43 [DEBUG   ] Got command RPT from MCS: ref #228425
2018-10-21 22:11:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228425  77 58412 79903645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:11:43 [DEBUG   ] Got command RPT from MCS: ref #228426
2018-10-21 22:11:43 [DEBUG   ] summary = ERROR
2018-10-21 22:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228426  13 58412 79903849 A  ERRORERROR'
2018-10-21 22:11:44 [DEBUG   ] Got command RPT from MCS: ref #228428
2018-10-21 22:11:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228428  77 58412 79904053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:11:44 [DEBUG   ] Got command RPT from MCS: ref #228429
2018-10-21 22:11:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228429  12 58412 79904245 A  ERRORB›™š'
2018-10-21 22:11:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 22:12:04 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2018-10-21 22:12:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:12:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:12:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:12:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:12:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:12:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:12:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:12:33 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-10-21 22:12:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:13:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:13:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:13:28 [DEBUG   ] Got command RPT from MCS: ref #228438
2018-10-21 22:13:28 [DEBUG   ] summary = ERROR
2018-10-21 22:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228438  13 58412 80008709 A  ERRORERROR'
2018-10-21 22:13:28 [DEBUG   ] Got command RPT from MCS: ref #228439
2018-10-21 22:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228439  77 58412 80008710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:13:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:13:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:13:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:13:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:13:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:13:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:13:33 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-10-21 22:13:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:14:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:14:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:14:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:14:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 22:14:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 22:14:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:14:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:14:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:14:33 [WARNING ] (13, 1, 'bot')
2018-10-21 22:14:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:14:33 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-10-21 22:14:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:15:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:15:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:15:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:15:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:15:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:15:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:15:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:15:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:15:34 [DEBUG   ] Finished updating board flags in 2.160 seconds
2018-10-21 22:15:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:16:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 22:16:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:16:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:16:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:16:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:16:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:16:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:16:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:16:34 [DEBUG   ] Finished updating board flags in 1.893 seconds
2018-10-21 22:16:43 [DEBUG   ] Got command RPT from MCS: ref #228459
2018-10-21 22:16:43 [DEBUG   ] summary = ERROR
2018-10-21 22:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228459  13 58412 80203525 A  ERRORERROR'
2018-10-21 22:16:43 [DEBUG   ] Got command RPT from MCS: ref #228460
2018-10-21 22:16:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228460  77 58412 80203730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:16:43 [DEBUG   ] Got command RPT from MCS: ref #228461
2018-10-21 22:16:43 [DEBUG   ] summary = ERROR
2018-10-21 22:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228461  13 58412 80203922 A  ERRORERROR'
2018-10-21 22:16:44 [DEBUG   ] Got command RPT from MCS: ref #228462
2018-10-21 22:16:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228462  77 58412 80204125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:16:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:16:44 [DEBUG   ] Got command RPT from MCS: ref #228463
2018-10-21 22:16:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228463  12 58412 80204330 A  ERRORB›™š'
2018-10-21 22:17:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:17:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:17:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 22:17:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:17:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:17:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:17:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:17:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:17:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:17:34 [DEBUG   ] Finished updating board flags in 1.846 seconds
2018-10-21 22:17:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:18:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:18:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:18:28 [DEBUG   ] Got command RPT from MCS: ref #228468
2018-10-21 22:18:28 [DEBUG   ] summary = ERROR
2018-10-21 22:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228468  13 58412 80308709 A  ERRORERROR'
2018-10-21 22:18:28 [DEBUG   ] Got command RPT from MCS: ref #228469
2018-10-21 22:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228469  77 58412 80308710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:18:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:18:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:18:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:18:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:18:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:18:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:18:34 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-10-21 22:18:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:19:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:19:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:19:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:19:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:19:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:19:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:19:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:19:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:19:34 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-21 22:19:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:20:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 22:20:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:20:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:20:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:20:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:20:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:20:34 [WARNING ] (13, 1, 'bot')
2018-10-21 22:20:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:20:34 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-10-21 22:20:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:21:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:21:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:21:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:21:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:21:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:21:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:21:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:21:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:21:35 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-21 22:21:43 [DEBUG   ] Got command RPT from MCS: ref #228491
2018-10-21 22:21:43 [DEBUG   ] summary = ERROR
2018-10-21 22:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228491  13 58412 80503605 A  ERRORERROR'
2018-10-21 22:21:43 [DEBUG   ] Got command RPT from MCS: ref #228492
2018-10-21 22:21:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228492  77 58412 80503809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:21:44 [DEBUG   ] Got command RPT from MCS: ref #228493
2018-10-21 22:21:44 [DEBUG   ] summary = ERROR
2018-10-21 22:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228493  13 58412 80504001 A  ERRORERROR'
2018-10-21 22:21:44 [DEBUG   ] Got command RPT from MCS: ref #228495
2018-10-21 22:21:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228495  77 58412 80504205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:21:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:21:44 [DEBUG   ] Got command RPT from MCS: ref #228496
2018-10-21 22:21:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228496  12 58412 80504409 A  ERRORB›™š'
2018-10-21 22:22:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:22:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:22:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:22:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 22:22:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 22:22:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:22:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:22:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:22:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:22:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:22:35 [DEBUG   ] Finished updating board flags in 2.169 seconds
2018-10-21 22:22:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:23:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:23:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:23:28 [DEBUG   ] Got command RPT from MCS: ref #228501
2018-10-21 22:23:28 [DEBUG   ] summary = ERROR
2018-10-21 22:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228501  13 58412 80608721 A  ERRORERROR'
2018-10-21 22:23:28 [DEBUG   ] Got command RPT from MCS: ref #228502
2018-10-21 22:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228502  77 58412 80608722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:23:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:23:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 22:23:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:23:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:23:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:23:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:23:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:23:35 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-21 22:23:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:24:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:24:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:24:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 22:24:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:24:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:24:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:24:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:24:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:24:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:24:35 [DEBUG   ] Finished updating board flags in 1.871 seconds
2018-10-21 22:24:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:25:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:25:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:25:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:25:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 22:25:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:25:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:25:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:25:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:25:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:25:35 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-21 22:25:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:26:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:26:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:26:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:26:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:26:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:26:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:26:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:26:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:26:35 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-10-21 22:26:43 [DEBUG   ] Got command RPT from MCS: ref #228522
2018-10-21 22:26:43 [DEBUG   ] summary = ERROR
2018-10-21 22:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228522  13 58412 80803685 A  ERRORERROR'
2018-10-21 22:26:43 [DEBUG   ] Got command RPT from MCS: ref #228523
2018-10-21 22:26:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228523  77 58412 80803889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:26:44 [DEBUG   ] Got command RPT from MCS: ref #228524
2018-10-21 22:26:44 [DEBUG   ] summary = ERROR
2018-10-21 22:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228524  13 58412 80804081 A  ERRORERROR'
2018-10-21 22:26:44 [DEBUG   ] Got command RPT from MCS: ref #228525
2018-10-21 22:26:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228525  77 58412 80804285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:26:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 22:26:44 [DEBUG   ] Got command RPT from MCS: ref #228526
2018-10-21 22:26:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228526  12 58412 80804489 A  ERRORB›™š'
2018-10-21 22:27:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:27:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:27:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:27:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:27:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:27:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:27:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:27:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:27:35 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-21 22:27:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:28:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:28:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:28:28 [DEBUG   ] Got command RPT from MCS: ref #228531
2018-10-21 22:28:28 [DEBUG   ] summary = ERROR
2018-10-21 22:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228531  13 58412 80908713 A  ERRORERROR'
2018-10-21 22:28:28 [DEBUG   ] Got command RPT from MCS: ref #228532
2018-10-21 22:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228532  77 58412 80908714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:28:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:28:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 22:28:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:28:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:28:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:28:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:28:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:28:35 [DEBUG   ] Finished updating board flags in 1.643 seconds
2018-10-21 22:28:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:29:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:29:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:29:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:29:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:29:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:29:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:29:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:29:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:29:35 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-21 22:29:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 22:30:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 22:30:24 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2018-10-21 22:30:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:30:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 22:30:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:30:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:30:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:30:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:30:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:30:35 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-10-21 22:30:44 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 22:31:04 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-21 22:31:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:31:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 22:31:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:31:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:31:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:31:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:31:35 [WARNING ] (13, 1, 'bot')
2018-10-21 22:31:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:31:35 [DEBUG   ] Finished updating board flags in 1.526 seconds
2018-10-21 22:31:43 [DEBUG   ] Got command RPT from MCS: ref #228554
2018-10-21 22:31:43 [DEBUG   ] summary = ERROR
2018-10-21 22:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228554  13 58412 81103765 A  ERRORERROR'
2018-10-21 22:31:43 [DEBUG   ] Got command RPT from MCS: ref #228555
2018-10-21 22:31:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228555  77 58412 81103969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:31:44 [DEBUG   ] Got command RPT from MCS: ref #228556
2018-10-21 22:31:44 [DEBUG   ] summary = ERROR
2018-10-21 22:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228556  13 58412 81104161 A  ERRORERROR'
2018-10-21 22:31:44 [DEBUG   ] Got command RPT from MCS: ref #228558
2018-10-21 22:31:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228558  77 58412 81104365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:31:44 [DEBUG   ] Got command RPT from MCS: ref #228559
2018-10-21 22:31:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228559  12 58412 81104573 A  ERRORB›™š'
2018-10-21 22:31:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:32:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:32:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:32:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 22:32:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:32:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:32:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:32:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:32:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:32:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:32:36 [DEBUG   ] Finished updating board flags in 2.233 seconds
2018-10-21 22:32:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:33:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 22:33:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:33:28 [DEBUG   ] Got command RPT from MCS: ref #228568
2018-10-21 22:33:28 [DEBUG   ] summary = ERROR
2018-10-21 22:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228568  13 58412 81208713 A  ERRORERROR'
2018-10-21 22:33:28 [DEBUG   ] Got command RPT from MCS: ref #228569
2018-10-21 22:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228569  77 58412 81208714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:33:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:33:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:33:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:33:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:33:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:33:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:33:36 [DEBUG   ] Finished updating board flags in 2.080 seconds
2018-10-21 22:33:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:34:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:34:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:34:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:34:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 22:34:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 22:34:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:34:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:34:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:34:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:34:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:34:36 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-10-21 22:34:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:35:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:35:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:35:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:35:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:35:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:35:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:35:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:35:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:35:36 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-21 22:35:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-21 22:36:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 22:36:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 22:36:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:36:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:36:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:36:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:36:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:36:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:36:36 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-21 22:36:43 [DEBUG   ] Got command RPT from MCS: ref #228589
2018-10-21 22:36:43 [DEBUG   ] summary = ERROR
2018-10-21 22:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228589  13 58412 81403841 A  ERRORERROR'
2018-10-21 22:36:44 [DEBUG   ] Got command RPT from MCS: ref #228590
2018-10-21 22:36:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228590  77 58412 81404045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:36:44 [DEBUG   ] Got command RPT from MCS: ref #228591
2018-10-21 22:36:44 [DEBUG   ] summary = ERROR
2018-10-21 22:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228591  13 58412 81404249 A  ERRORERROR'
2018-10-21 22:36:44 [DEBUG   ] Got command RPT from MCS: ref #228592
2018-10-21 22:36:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228592  77 58412 81404453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:36:44 [DEBUG   ] Got command RPT from MCS: ref #228593
2018-10-21 22:36:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228593  12 58412 81404645 A  ERRORB›™š'
2018-10-21 22:36:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 22:37:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 22:37:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 22:37:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 22:37:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:37:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:37:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:37:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:37:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:37:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:37:36 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-10-21 22:37:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 22:38:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 22:38:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 22:38:28 [DEBUG   ] Got command RPT from MCS: ref #228594
2018-10-21 22:38:28 [DEBUG   ] summary = ERROR
2018-10-21 22:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228594  13 58412 81508717 A  ERRORERROR'
2018-10-21 22:38:28 [DEBUG   ] Got command RPT from MCS: ref #228595
2018-10-21 22:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228595  77 58412 81508718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:38:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:38:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:38:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:38:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:38:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:38:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:38:36 [DEBUG   ] Finished updating board flags in 1.694 seconds
2018-10-21 22:38:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 22:39:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 22:39:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 22:39:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:39:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 22:39:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:39:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:39:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:39:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:39:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:39:36 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-10-21 22:39:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 22:40:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 22:40:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 22:40:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 22:40:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:40:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:40:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:40:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:40:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:40:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:40:36 [DEBUG   ] Finished updating board flags in 1.504 seconds
2018-10-21 22:40:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:41:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:41:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:41:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:41:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:41:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:41:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:41:36 [WARNING ] (13, 1, 'bot')
2018-10-21 22:41:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:41:36 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-10-21 22:41:43 [DEBUG   ] Got command RPT from MCS: ref #228617
2018-10-21 22:41:43 [DEBUG   ] summary = ERROR
2018-10-21 22:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228617  13 58412 81703921 A  ERRORERROR'
2018-10-21 22:41:44 [DEBUG   ] Got command RPT from MCS: ref #228618
2018-10-21 22:41:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228618  77 58412 81704125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:41:44 [DEBUG   ] Got command RPT from MCS: ref #228619
2018-10-21 22:41:44 [DEBUG   ] summary = ERROR
2018-10-21 22:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228619  13 58412 81704329 A  ERRORERROR'
2018-10-21 22:41:44 [DEBUG   ] Got command RPT from MCS: ref #228621
2018-10-21 22:41:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228621  77 58412 81704534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:41:44 [DEBUG   ] Got command RPT from MCS: ref #228623
2018-10-21 22:41:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228623  12 58412 81704725 A  ERRORB›™š'
2018-10-21 22:41:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:42:05 [DEBUG   ] Finished updating ant stats in 0.787 seconds
2018-10-21 22:42:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 22:42:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:42:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 22:42:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 22:42:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 22:42:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:42:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:42:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:42:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:42:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:42:37 [DEBUG   ] Finished updating board flags in 2.228 seconds
2018-10-21 22:42:46 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2018-10-21 22:43:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-21 22:43:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 22:43:28 [DEBUG   ] Got command RPT from MCS: ref #228631
2018-10-21 22:43:28 [DEBUG   ] summary = ERROR
2018-10-21 22:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228631  13 58412 81808725 A  ERRORERROR'
2018-10-21 22:43:28 [DEBUG   ] Got command RPT from MCS: ref #228632
2018-10-21 22:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228632  77 58412 81808726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:43:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:43:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 22:43:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 22:43:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:43:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:43:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:43:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:43:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:43:37 [DEBUG   ] Finished updating board flags in 2.168 seconds
2018-10-21 22:43:46 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-21 22:44:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 22:44:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 22:44:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:44:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:44:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:44:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:44:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:44:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:44:37 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-10-21 22:44:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 22:45:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-21 22:45:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 22:45:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:45:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 22:45:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:45:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:45:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:45:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:45:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:45:37 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-10-21 22:45:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 22:46:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 22:46:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:46:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:46:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 22:46:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:46:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:46:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:46:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:46:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:46:37 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-21 22:46:44 [DEBUG   ] Got command RPT from MCS: ref #228652
2018-10-21 22:46:44 [DEBUG   ] summary = ERROR
2018-10-21 22:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228652  13 58412 82004005 A  ERRORERROR'
2018-10-21 22:46:44 [DEBUG   ] Got command RPT from MCS: ref #228653
2018-10-21 22:46:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228653  77 58412 82004209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:46:44 [DEBUG   ] Got command RPT from MCS: ref #228654
2018-10-21 22:46:44 [DEBUG   ] summary = ERROR
2018-10-21 22:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228654  13 58412 82004413 A  ERRORERROR'
2018-10-21 22:46:44 [DEBUG   ] Got command RPT from MCS: ref #228655
2018-10-21 22:46:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228655  77 58412 82004605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:46:44 [DEBUG   ] Got command RPT from MCS: ref #228656
2018-10-21 22:46:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228656  12 58412 82004809 A  ERRORB›™š'
2018-10-21 22:46:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:47:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 22:47:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 22:47:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:47:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:47:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:47:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:47:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:47:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:47:37 [DEBUG   ] Finished updating board flags in 2.072 seconds
2018-10-21 22:47:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 22:48:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 22:48:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 22:48:28 [DEBUG   ] Got command RPT from MCS: ref #228661
2018-10-21 22:48:28 [DEBUG   ] summary = ERROR
2018-10-21 22:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228661  13 58412 82108717 A  ERRORERROR'
2018-10-21 22:48:28 [DEBUG   ] Got command RPT from MCS: ref #228662
2018-10-21 22:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228662  77 58412 82108718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:48:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 22:48:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:48:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:48:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:48:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:48:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:48:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:48:37 [DEBUG   ] Finished updating board flags in 1.908 seconds
2018-10-21 22:48:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 22:49:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 22:49:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 22:49:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:49:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 22:49:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:49:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:49:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:49:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:49:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:49:37 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-10-21 22:49:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 22:50:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 22:50:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 22:50:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:50:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:50:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:50:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:50:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:50:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:50:37 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-21 22:50:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-21 22:51:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 22:51:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 22:51:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:51:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 22:51:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:51:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:51:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:51:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:51:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:51:37 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-10-21 22:51:44 [DEBUG   ] Got command RPT from MCS: ref #228684
2018-10-21 22:51:44 [DEBUG   ] summary = ERROR
2018-10-21 22:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228684  13 58412 82304085 A  ERRORERROR'
2018-10-21 22:51:44 [DEBUG   ] Got command RPT from MCS: ref #228685
2018-10-21 22:51:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228685  77 58412 82304289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:51:44 [DEBUG   ] Got command RPT from MCS: ref #228686
2018-10-21 22:51:44 [DEBUG   ] summary = ERROR
2018-10-21 22:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228686  13 58412 82304493 A  ERRORERROR'
2018-10-21 22:51:44 [DEBUG   ] Got command RPT from MCS: ref #228688
2018-10-21 22:51:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228688  77 58412 82304685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:51:44 [DEBUG   ] Got command RPT from MCS: ref #228689
2018-10-21 22:51:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:51:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228689  12 58412 82304889 A  ERRORB›™š'
2018-10-21 22:51:46 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-21 22:52:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:52:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:52:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:52:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:52:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:52:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:52:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:52:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:52:37 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-10-21 22:52:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:53:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:53:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:53:28 [DEBUG   ] Got command RPT from MCS: ref #228694
2018-10-21 22:53:28 [DEBUG   ] summary = ERROR
2018-10-21 22:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228694  13 58412 82408721 A  ERRORERROR'
2018-10-21 22:53:28 [DEBUG   ] Got command RPT from MCS: ref #228695
2018-10-21 22:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228695  77 58412 82408722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:53:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:53:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 22:53:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:53:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:53:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:53:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:53:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:53:37 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-10-21 22:53:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:54:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:54:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:54:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:54:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:54:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:54:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:54:37 [WARNING ] (13, 1, 'bot')
2018-10-21 22:54:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:54:37 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-21 22:54:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:55:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:55:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:55:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 22:55:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:55:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 22:55:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 22:55:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:55:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:55:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:55:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:55:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:55:38 [DEBUG   ] Finished updating board flags in 2.258 seconds
2018-10-21 22:55:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:56:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:56:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:56:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:56:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:56:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:56:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:56:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:56:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:56:38 [DEBUG   ] Finished updating board flags in 2.235 seconds
2018-10-21 22:56:44 [DEBUG   ] Got command RPT from MCS: ref #228715
2018-10-21 22:56:44 [DEBUG   ] summary = ERROR
2018-10-21 22:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228715  13 58412 82604169 A  ERRORERROR'
2018-10-21 22:56:44 [DEBUG   ] Got command RPT from MCS: ref #228716
2018-10-21 22:56:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228716  77 58412 82604361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:56:44 [DEBUG   ] Got command RPT from MCS: ref #228717
2018-10-21 22:56:44 [DEBUG   ] summary = ERROR
2018-10-21 22:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228717  13 58412 82604565 A  ERRORERROR'
2018-10-21 22:56:44 [DEBUG   ] Got command RPT from MCS: ref #228718
2018-10-21 22:56:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228718  77 58412 82604769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:56:44 [DEBUG   ] Got command RPT from MCS: ref #228719
2018-10-21 22:56:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 22:56:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228719  12 58412 82604973 A  ERRORB›™š'
2018-10-21 22:56:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:57:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:57:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:57:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:57:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:57:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:57:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:57:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:57:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:57:38 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-10-21 22:57:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 22:58:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:58:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:58:28 [DEBUG   ] Got command RPT from MCS: ref #228724
2018-10-21 22:58:28 [DEBUG   ] summary = ERROR
2018-10-21 22:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228724  13 58412 82708725 A  ERRORERROR'
2018-10-21 22:58:28 [DEBUG   ] Got command RPT from MCS: ref #228725
2018-10-21 22:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 22:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228725  77 58412 82708726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 22:58:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:58:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:58:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:58:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:58:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:58:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:58:38 [DEBUG   ] Finished updating board flags in 2.090 seconds
2018-10-21 22:58:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 22:59:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 22:59:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 22:59:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 22:59:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 22:59:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:59:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:59:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:59:38 [WARNING ] (13, 1, 'bot')
2018-10-21 22:59:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 22:59:38 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-10-21 22:59:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 23:00:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 23:00:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:00:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:00:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:00:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:00:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:00:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:00:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:00:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:00:38 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-21 23:00:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-21 23:01:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 23:01:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 23:01:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:01:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 23:01:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:01:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:01:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:01:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:01:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:01:38 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-10-21 23:01:44 [DEBUG   ] Got command RPT from MCS: ref #228747
2018-10-21 23:01:44 [DEBUG   ] summary = ERROR
2018-10-21 23:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228747  13 58412 82904241 A  ERRORERROR'
2018-10-21 23:01:44 [DEBUG   ] Got command RPT from MCS: ref #228748
2018-10-21 23:01:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228748  77 58412 82904445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:01:44 [DEBUG   ] Got command RPT from MCS: ref #228749
2018-10-21 23:01:44 [DEBUG   ] summary = ERROR
2018-10-21 23:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228749  13 58412 82904649 A  ERRORERROR'
2018-10-21 23:01:44 [DEBUG   ] Got command RPT from MCS: ref #228751
2018-10-21 23:01:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:01:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228751  77 58412 82904841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:01:45 [DEBUG   ] Got command RPT from MCS: ref #228753
2018-10-21 23:01:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228753  12 58412 82905045 A  ERRORB›™š'
2018-10-21 23:01:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 23:02:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:02:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:02:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:02:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:02:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:02:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:02:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:02:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:02:38 [DEBUG   ] Finished updating board flags in 1.860 seconds
2018-10-21 23:02:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 23:03:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 23:03:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:03:28 [DEBUG   ] Got command RPT from MCS: ref #228761
2018-10-21 23:03:28 [DEBUG   ] summary = ERROR
2018-10-21 23:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228761  13 58412 83008729 A  ERRORERROR'
2018-10-21 23:03:28 [DEBUG   ] Got command RPT from MCS: ref #228762
2018-10-21 23:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228762  77 58412 83008730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:03:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:03:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:03:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:03:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:03:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:03:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:03:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:03:38 [DEBUG   ] Finished updating board flags in 1.726 seconds
2018-10-21 23:03:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:04:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 23:04:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:04:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:04:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:04:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:04:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:04:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:04:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:04:38 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-10-21 23:04:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:05:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 23:05:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 23:05:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:05:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 23:05:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:05:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:05:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:05:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:05:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:05:38 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-21 23:05:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 23:06:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:06:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:06:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 23:06:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:06:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 23:06:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:06:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:06:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:06:38 [WARNING ] (13, 1, 'bot')
2018-10-21 23:06:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:06:38 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-10-21 23:06:44 [DEBUG   ] Got command RPT from MCS: ref #228782
2018-10-21 23:06:44 [DEBUG   ] summary = ERROR
2018-10-21 23:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228782  13 58412 83204329 A  ERRORERROR'
2018-10-21 23:06:44 [DEBUG   ] Got command RPT from MCS: ref #228783
2018-10-21 23:06:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228783  77 58412 83204521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:06:44 [DEBUG   ] Got command RPT from MCS: ref #228784
2018-10-21 23:06:44 [DEBUG   ] summary = ERROR
2018-10-21 23:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228784  13 58412 83204725 A  ERRORERROR'
2018-10-21 23:06:44 [DEBUG   ] Got command RPT from MCS: ref #228785
2018-10-21 23:06:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228785  77 58412 83204929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:06:45 [DEBUG   ] Got command RPT from MCS: ref #228786
2018-10-21 23:06:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228786  12 58412 83205133 A  ERRORB›™š'
2018-10-21 23:06:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 23:07:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:07:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 23:07:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:07:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 23:07:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:07:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:07:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:07:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:07:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:07:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:07:39 [DEBUG   ] Finished updating board flags in 2.270 seconds
2018-10-21 23:07:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 23:08:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 23:08:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 23:08:28 [DEBUG   ] Got command RPT from MCS: ref #228787
2018-10-21 23:08:28 [DEBUG   ] summary = ERROR
2018-10-21 23:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228787  13 58412 83308725 A  ERRORERROR'
2018-10-21 23:08:28 [DEBUG   ] Got command RPT from MCS: ref #228788
2018-10-21 23:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228788  77 58412 83308726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:08:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:08:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:08:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:08:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:08:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:08:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:08:39 [DEBUG   ] Finished updating board flags in 2.117 seconds
2018-10-21 23:08:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:09:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:09:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 23:09:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:09:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 23:09:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:09:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:09:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:09:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:09:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:09:39 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-10-21 23:09:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 23:10:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:10:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:10:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:10:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:10:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:10:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:10:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:10:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:10:39 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-10-21 23:10:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 23:11:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:11:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:11:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:11:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 23:11:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:11:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:11:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:11:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:11:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:11:39 [DEBUG   ] Finished updating board flags in 1.944 seconds
2018-10-21 23:11:44 [DEBUG   ] Got command RPT from MCS: ref #228810
2018-10-21 23:11:44 [DEBUG   ] summary = ERROR
2018-10-21 23:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228810  13 58412 83504401 A  ERRORERROR'
2018-10-21 23:11:44 [DEBUG   ] Got command RPT from MCS: ref #228811
2018-10-21 23:11:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228811  77 58412 83504605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:11:44 [DEBUG   ] Got command RPT from MCS: ref #228812
2018-10-21 23:11:44 [DEBUG   ] summary = ERROR
2018-10-21 23:11:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228812  13 58412 83504809 A  ERRORERROR'
2018-10-21 23:11:45 [DEBUG   ] Got command RPT from MCS: ref #228814
2018-10-21 23:11:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:11:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228814  77 58412 83505001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:11:45 [DEBUG   ] Got command RPT from MCS: ref #228815
2018-10-21 23:11:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:11:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228815  12 58412 83505205 A  ERRORB›™š'
2018-10-21 23:11:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 23:12:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:12:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:12:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:12:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:12:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:12:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:12:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:12:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:12:39 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-21 23:12:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:13:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:13:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:13:28 [DEBUG   ] Got command RPT from MCS: ref #228824
2018-10-21 23:13:28 [DEBUG   ] summary = ERROR
2018-10-21 23:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228824  13 58412 83608721 A  ERRORERROR'
2018-10-21 23:13:28 [DEBUG   ] Got command RPT from MCS: ref #228825
2018-10-21 23:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228825  77 58412 83608722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:13:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:13:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:13:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:13:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:13:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:13:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:13:39 [DEBUG   ] Finished updating board flags in 1.840 seconds
2018-10-21 23:13:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:14:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:14:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:14:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 23:14:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:14:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:14:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:14:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:14:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:14:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:14:39 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-10-21 23:14:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:15:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:15:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:15:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:15:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 23:15:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:15:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:15:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:15:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:15:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:15:39 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-10-21 23:15:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:16:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 23:16:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 23:16:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:16:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:16:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:16:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:16:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:16:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:16:39 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-21 23:16:44 [DEBUG   ] Got command RPT from MCS: ref #228845
2018-10-21 23:16:44 [DEBUG   ] summary = ERROR
2018-10-21 23:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228845  13 58412 83804481 A  ERRORERROR'
2018-10-21 23:16:44 [DEBUG   ] Got command RPT from MCS: ref #228846
2018-10-21 23:16:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228846  77 58412 83804685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:16:44 [DEBUG   ] Got command RPT from MCS: ref #228847
2018-10-21 23:16:44 [DEBUG   ] summary = ERROR
2018-10-21 23:16:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228847  13 58412 83804889 A  ERRORERROR'
2018-10-21 23:16:45 [DEBUG   ] Got command RPT from MCS: ref #228848
2018-10-21 23:16:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228848  77 58412 83805081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:16:45 [DEBUG   ] Got command RPT from MCS: ref #228849
2018-10-21 23:16:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228849  12 58412 83805285 A  ERRORBš™š'
2018-10-21 23:16:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:17:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:17:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:17:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:17:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:17:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:17:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:17:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:17:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:17:39 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-10-21 23:17:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 23:18:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:18:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 23:18:28 [DEBUG   ] Got command RPT from MCS: ref #228854
2018-10-21 23:18:28 [DEBUG   ] summary = ERROR
2018-10-21 23:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228854  13 58412 83908733 A  ERRORERROR'
2018-10-21 23:18:28 [DEBUG   ] Got command RPT from MCS: ref #228855
2018-10-21 23:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228855  77 58412 83908734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:18:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:18:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:18:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:18:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:18:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:18:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:18:39 [DEBUG   ] Finished updating board flags in 1.535 seconds
2018-10-21 23:18:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:19:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 23:19:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-21 23:19:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:19:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 23:19:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:19:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:19:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:19:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:19:39 [WARNING ] (13, 1, 'bot')
2018-10-21 23:19:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:19:39 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-10-21 23:19:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-21 23:20:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 23:20:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 23:20:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:20:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:20:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:20:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:20:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:20:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:20:40 [DEBUG   ] Finished updating board flags in 2.186 seconds
2018-10-21 23:20:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 23:21:08 [DEBUG   ] Finished updating ant stats in 1.385 seconds
2018-10-21 23:21:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 23:21:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:21:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 23:21:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:21:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:21:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:21:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:21:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:21:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:21:40 [DEBUG   ] Finished updating board flags in 1.920 seconds
2018-10-21 23:21:44 [DEBUG   ] Got command RPT from MCS: ref #228877
2018-10-21 23:21:44 [DEBUG   ] summary = ERROR
2018-10-21 23:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228877  13 58412 84104569 A  ERRORERROR'
2018-10-21 23:21:44 [DEBUG   ] Got command RPT from MCS: ref #228878
2018-10-21 23:21:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228878  77 58412 84104761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:21:44 [DEBUG   ] Got command RPT from MCS: ref #228879
2018-10-21 23:21:44 [DEBUG   ] summary = ERROR
2018-10-21 23:21:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228879  13 58412 84104965 A  ERRORERROR'
2018-10-21 23:21:45 [DEBUG   ] Got command RPT from MCS: ref #228881
2018-10-21 23:21:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228881  77 58412 84105169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:21:45 [DEBUG   ] Got command RPT from MCS: ref #228883
2018-10-21 23:21:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228883  12 58412 84105373 A  ERRORBš™š'
2018-10-21 23:21:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:22:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:22:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 23:22:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 23:22:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:22:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:22:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:22:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:22:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:22:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:22:40 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-10-21 23:22:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 23:23:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:23:28 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-21 23:23:28 [DEBUG   ] Got command RPT from MCS: ref #228887
2018-10-21 23:23:28 [DEBUG   ] summary = ERROR
2018-10-21 23:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228887  13 58412 84208725 A  ERRORERROR'
2018-10-21 23:23:28 [DEBUG   ] Got command RPT from MCS: ref #228888
2018-10-21 23:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228888  77 58412 84208726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:23:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:23:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 23:23:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 23:23:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:23:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:23:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:23:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:23:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:23:40 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-10-21 23:23:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 23:24:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 23:24:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:24:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 23:24:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:24:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:24:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:24:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:24:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:24:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:24:40 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-10-21 23:24:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:25:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:25:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 23:25:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:25:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:25:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:25:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:25:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:25:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:25:40 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-10-21 23:25:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 23:26:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 23:26:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 23:26:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:26:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:26:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:26:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:26:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:26:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:26:40 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-21 23:26:44 [DEBUG   ] Got command RPT from MCS: ref #228908
2018-10-21 23:26:44 [DEBUG   ] summary = ERROR
2018-10-21 23:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228908  13 58412 84404649 A  ERRORERROR'
2018-10-21 23:26:44 [DEBUG   ] Got command RPT from MCS: ref #228909
2018-10-21 23:26:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228909  77 58412 84404853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:26:45 [DEBUG   ] Got command RPT from MCS: ref #228910
2018-10-21 23:26:45 [DEBUG   ] summary = ERROR
2018-10-21 23:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228910  13 58412 84405045 A  ERRORERROR'
2018-10-21 23:26:45 [DEBUG   ] Got command RPT from MCS: ref #228911
2018-10-21 23:26:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228911  77 58412 84405249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:26:45 [DEBUG   ] Got command RPT from MCS: ref #228912
2018-10-21 23:26:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228912  12 58412 84405453 A  ERRORB›™š'
2018-10-21 23:26:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 23:27:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 23:27:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 23:27:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:27:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:27:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:27:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:27:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:27:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:27:40 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-21 23:27:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 23:28:08 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-21 23:28:28 [DEBUG   ] Got command RPT from MCS: ref #228917
2018-10-21 23:28:28 [DEBUG   ] summary = ERROR
2018-10-21 23:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228917  13 58412 84508725 A  ERRORERROR'
2018-10-21 23:28:28 [DEBUG   ] Got command RPT from MCS: ref #228918
2018-10-21 23:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228918  77 58412 84508726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:28:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 23:28:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:28:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 23:28:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:28:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:28:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:28:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:28:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:28:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:28:40 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-10-21 23:28:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 23:29:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 23:29:29 [DEBUG   ] Finished updating ant stats in 0.943 seconds
2018-10-21 23:29:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 23:29:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:29:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:29:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:29:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:29:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:29:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:29:40 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-21 23:29:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 23:30:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:30:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 23:30:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:30:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:30:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:30:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:30:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:30:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:30:40 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-21 23:30:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 23:31:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 23:31:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 23:31:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:31:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 23:31:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 23:31:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:31:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:31:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:31:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:31:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:31:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:31:40 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-21 23:31:44 [DEBUG   ] Got command RPT from MCS: ref #228940
2018-10-21 23:31:44 [DEBUG   ] summary = ERROR
2018-10-21 23:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228940  13 58412 84704729 A  ERRORERROR'
2018-10-21 23:31:44 [DEBUG   ] Got command RPT from MCS: ref #228941
2018-10-21 23:31:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228941  77 58412 84704933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:31:45 [DEBUG   ] Got command RPT from MCS: ref #228942
2018-10-21 23:31:45 [DEBUG   ] summary = ERROR
2018-10-21 23:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228942  13 58412 84705125 A  ERRORERROR'
2018-10-21 23:31:45 [DEBUG   ] Got command RPT from MCS: ref #228944
2018-10-21 23:31:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228944  77 58412 84705329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:31:45 [DEBUG   ] Got command RPT from MCS: ref #228945
2018-10-21 23:31:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228945  12 58412 84705533 A  ERRORB›™š'
2018-10-21 23:31:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 23:32:10 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-21 23:32:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 23:32:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 23:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:32:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 23:32:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:32:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:32:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:32:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:32:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:32:40 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-21 23:32:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:33:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:33:28 [DEBUG   ] Got command RPT from MCS: ref #228954
2018-10-21 23:33:28 [DEBUG   ] summary = ERROR
2018-10-21 23:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228954  13 58412 84808729 A  ERRORERROR'
2018-10-21 23:33:28 [DEBUG   ] Got command RPT from MCS: ref #228955
2018-10-21 23:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228955  77 58412 84808730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:33:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 23:33:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:33:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:33:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:33:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:33:40 [WARNING ] (13, 1, 'bot')
2018-10-21 23:33:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:33:40 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-10-21 23:33:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 23:34:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:34:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:34:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:34:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:34:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:34:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:34:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:34:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:34:41 [DEBUG   ] Finished updating board flags in 2.257 seconds
2018-10-21 23:34:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-21 23:35:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 23:35:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:35:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:35:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 23:35:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:35:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:35:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:35:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:35:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:35:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:35:41 [DEBUG   ] Finished updating board flags in 2.136 seconds
2018-10-21 23:35:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 23:36:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:36:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 23:36:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:36:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 23:36:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:36:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:36:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:36:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:36:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:36:41 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-10-21 23:36:44 [DEBUG   ] Got command RPT from MCS: ref #228975
2018-10-21 23:36:44 [DEBUG   ] summary = ERROR
2018-10-21 23:36:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228975  13 58412 85004805 A  ERRORERROR'
2018-10-21 23:36:45 [DEBUG   ] Got command RPT from MCS: ref #228976
2018-10-21 23:36:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228976  77 58412 85005009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:36:45 [DEBUG   ] Got command RPT from MCS: ref #228977
2018-10-21 23:36:45 [DEBUG   ] summary = ERROR
2018-10-21 23:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228977  13 58412 85005213 A  ERRORERROR'
2018-10-21 23:36:45 [DEBUG   ] Got command RPT from MCS: ref #228978
2018-10-21 23:36:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228978  77 58412 85005417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:36:45 [DEBUG   ] Got command RPT from MCS: ref #228979
2018-10-21 23:36:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228979  12 58412 85005609 A  ERRORB›™š'
2018-10-21 23:36:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 23:37:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 23:37:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 23:37:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:37:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 23:37:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:37:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:37:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:37:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:37:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:37:41 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-10-21 23:37:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 23:38:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 23:38:28 [DEBUG   ] Got command RPT from MCS: ref #228980
2018-10-21 23:38:28 [DEBUG   ] summary = ERROR
2018-10-21 23:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228980  13 58412 85108729 A  ERRORERROR'
2018-10-21 23:38:28 [DEBUG   ] Got command RPT from MCS: ref #228981
2018-10-21 23:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   228981  77 58412 85108730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:38:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-21 23:38:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:38:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:38:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:38:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:38:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:38:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:38:41 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-21 23:38:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 23:39:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:39:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 23:39:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:39:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 23:39:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:39:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:39:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:39:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:39:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:39:41 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-10-21 23:39:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 23:40:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-21 23:40:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:40:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:40:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:40:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:40:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:40:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:40:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:40:41 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-21 23:40:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 23:41:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:41:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 23:41:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:41:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:41:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:41:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:41:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:41:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:41:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:41:41 [DEBUG   ] Finished updating board flags in 1.697 seconds
2018-10-21 23:41:44 [DEBUG   ] Got command RPT from MCS: ref #229003
2018-10-21 23:41:44 [DEBUG   ] summary = ERROR
2018-10-21 23:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229003  13 58412 85304893 A  ERRORERROR'
2018-10-21 23:41:45 [DEBUG   ] Got command RPT from MCS: ref #229004
2018-10-21 23:41:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229004  77 58412 85305085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:41:45 [DEBUG   ] Got command RPT from MCS: ref #229005
2018-10-21 23:41:45 [DEBUG   ] summary = ERROR
2018-10-21 23:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229005  13 58412 85305289 A  ERRORERROR'
2018-10-21 23:41:45 [DEBUG   ] Got command RPT from MCS: ref #229007
2018-10-21 23:41:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229007  77 58412 85305493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:41:45 [DEBUG   ] Got command RPT from MCS: ref #229008
2018-10-21 23:41:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229008  12 58412 85305697 A  ERRORB›™š'
2018-10-21 23:41:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:42:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 23:42:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:42:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:42:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:42:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:42:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:42:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:42:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:42:41 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-10-21 23:42:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-21 23:43:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 23:43:28 [DEBUG   ] Got command RPT from MCS: ref #229017
2018-10-21 23:43:28 [DEBUG   ] summary = ERROR
2018-10-21 23:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229017  13 58412 85408733 A  ERRORERROR'
2018-10-21 23:43:28 [DEBUG   ] Got command RPT from MCS: ref #229018
2018-10-21 23:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229018  77 58412 85408734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:43:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 23:43:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:43:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:43:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:43:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:43:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:43:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:43:41 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-10-21 23:43:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 23:44:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 23:44:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 23:44:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:44:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:44:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:44:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:44:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:44:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:44:41 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-10-21 23:44:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 23:45:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-21 23:45:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-21 23:45:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-21 23:45:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:45:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:45:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:45:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:45:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:45:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:45:41 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-10-21 23:45:52 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-21 23:46:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-21 23:46:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 23:46:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:46:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-21 23:46:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-21 23:46:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:46:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:46:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:46:41 [WARNING ] (13, 1, 'bot')
2018-10-21 23:46:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:46:41 [DEBUG   ] Finished updating board flags in 1.460 seconds
2018-10-21 23:46:44 [DEBUG   ] Got command RPT from MCS: ref #229038
2018-10-21 23:46:44 [DEBUG   ] summary = ERROR
2018-10-21 23:46:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229038  13 58412 85604969 A  ERRORERROR'
2018-10-21 23:46:45 [DEBUG   ] Got command RPT from MCS: ref #229039
2018-10-21 23:46:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:46:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229039  77 58412 85605173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:46:45 [DEBUG   ] Got command RPT from MCS: ref #229040
2018-10-21 23:46:45 [DEBUG   ] summary = ERROR
2018-10-21 23:46:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229040  13 58412 85605377 A  ERRORERROR'
2018-10-21 23:46:45 [DEBUG   ] Got command RPT from MCS: ref #229041
2018-10-21 23:46:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:46:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229041  77 58412 85605569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:46:45 [DEBUG   ] Got command RPT from MCS: ref #229042
2018-10-21 23:46:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:46:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229042  12 58412 85605773 A  ERRORB›™š'
2018-10-21 23:46:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:47:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:47:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 23:47:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:47:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:47:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:47:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:47:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:47:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:47:42 [DEBUG   ] Finished updating board flags in 2.175 seconds
2018-10-21 23:47:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 23:48:12 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 23:48:28 [DEBUG   ] Got command RPT from MCS: ref #229047
2018-10-21 23:48:28 [DEBUG   ] summary = ERROR
2018-10-21 23:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229047  13 58412 85708737 A  ERRORERROR'
2018-10-21 23:48:28 [DEBUG   ] Got command RPT from MCS: ref #229048
2018-10-21 23:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229048  77 58412 85708738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:48:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-21 23:48:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:48:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 23:48:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:48:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:48:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:48:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:48:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:48:42 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-10-21 23:48:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-21 23:49:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-21 23:49:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-21 23:49:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 23:49:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:49:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:49:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:49:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:49:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:49:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:49:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:49:42 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-10-21 23:49:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-21 23:50:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-21 23:50:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 23:50:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:50:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:50:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:50:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:50:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:50:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:50:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:50:42 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-10-21 23:50:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-21 23:51:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 23:51:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-21 23:51:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:51:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:51:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:51:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:51:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:51:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:51:42 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-21 23:51:45 [DEBUG   ] Got command RPT from MCS: ref #229070
2018-10-21 23:51:45 [DEBUG   ] summary = ERROR
2018-10-21 23:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229070  13 58412 85905053 A  ERRORERROR'
2018-10-21 23:51:45 [DEBUG   ] Got command RPT from MCS: ref #229071
2018-10-21 23:51:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229071  77 58412 85905257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:51:45 [DEBUG   ] Got command RPT from MCS: ref #229072
2018-10-21 23:51:45 [DEBUG   ] summary = ERROR
2018-10-21 23:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229072  13 58412 85905449 A  ERRORERROR'
2018-10-21 23:51:45 [DEBUG   ] Got command RPT from MCS: ref #229074
2018-10-21 23:51:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229074  77 58412 85905653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:51:45 [DEBUG   ] Got command RPT from MCS: ref #229075
2018-10-21 23:51:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:51:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229075  12 58412 85905857 A  ERRORBš™š'
2018-10-21 23:51:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:52:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-21 23:52:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 23:52:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:52:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:52:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:52:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:52:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:52:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:52:42 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-10-21 23:52:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-21 23:53:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-21 23:53:28 [DEBUG   ] Got command RPT from MCS: ref #229080
2018-10-21 23:53:28 [DEBUG   ] summary = ERROR
2018-10-21 23:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229080  13 58412 86008737 A  ERRORERROR'
2018-10-21 23:53:28 [DEBUG   ] Got command RPT from MCS: ref #229081
2018-10-21 23:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229081  77 58412 86008738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:53:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:53:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-10-21 23:53:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:53:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:53:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:53:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:53:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:53:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:53:42 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-21 23:53:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:54:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-21 23:54:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-21 23:54:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:54:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-21 23:54:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:54:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:54:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:54:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:54:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:54:42 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-10-21 23:54:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 23:55:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-21 23:55:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-21 23:55:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:55:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:55:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:55:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:55:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:55:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:55:42 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-10-21 23:55:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-21 23:56:14 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-21 23:56:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:56:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 23:56:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:56:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-21 23:56:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-21 23:56:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:56:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:56:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:56:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:56:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:56:42 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-21 23:56:45 [DEBUG   ] Got command RPT from MCS: ref #229101
2018-10-21 23:56:45 [DEBUG   ] summary = ERROR
2018-10-21 23:56:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229101  13 58412 86205133 A  ERRORERROR'
2018-10-21 23:56:45 [DEBUG   ] Got command RPT from MCS: ref #229102
2018-10-21 23:56:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:56:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229102  77 58412 86205337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:56:45 [DEBUG   ] Got command RPT from MCS: ref #229103
2018-10-21 23:56:45 [DEBUG   ] summary = ERROR
2018-10-21 23:56:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229103  13 58412 86205529 A  ERRORERROR'
2018-10-21 23:56:45 [DEBUG   ] Got command RPT from MCS: ref #229104
2018-10-21 23:56:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:56:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229104  77 58412 86205733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:56:45 [DEBUG   ] Got command RPT from MCS: ref #229105
2018-10-21 23:56:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-21 23:56:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229105  12 58412 86205937 A  ERRORB›™š'
2018-10-21 23:56:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-21 23:57:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-21 23:57:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-21 23:57:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-21 23:57:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:57:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:57:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:57:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:57:42 [WARNING ] (13, 1, 'bot')
2018-10-21 23:57:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:57:42 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-10-21 23:57:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-21 23:58:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-21 23:58:28 [DEBUG   ] Got command RPT from MCS: ref #229110
2018-10-21 23:58:28 [DEBUG   ] summary = ERROR
2018-10-21 23:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229110  13 58412 86308737 A  ERRORERROR'
2018-10-21 23:58:28 [DEBUG   ] Got command RPT from MCS: ref #229111
2018-10-21 23:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-21 23:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229111  77 58412 86308738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-21 23:58:34 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-21 23:58:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:58:43 [WARNING ] (13, 1, 'bot')
2018-10-21 23:58:43 [WARNING ] (13, 1, 'bot')
2018-10-21 23:58:43 [WARNING ] (13, 1, 'bot')
2018-10-21 23:58:43 [WARNING ] (13, 1, 'bot')
2018-10-21 23:58:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:58:43 [DEBUG   ] Finished updating board flags in 2.206 seconds
2018-10-21 23:58:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-21 23:59:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-21 23:59:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-21 23:59:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-21 23:59:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-21 23:59:43 [WARNING ] (13, 1, 'bot')
2018-10-21 23:59:43 [WARNING ] (13, 1, 'bot')
2018-10-21 23:59:43 [WARNING ] (13, 1, 'bot')
2018-10-21 23:59:43 [WARNING ] (13, 1, 'bot')
2018-10-21 23:59:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-21 23:59:43 [DEBUG   ] Finished updating board flags in 2.175 seconds
2018-10-21 23:59:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 00:00:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 00:00:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 00:00:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:00:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:00:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:00:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:00:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:00:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:00:43 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-22 00:00:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 00:01:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 00:01:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 00:01:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 00:01:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:01:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:01:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:01:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:01:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:01:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:01:43 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-10-22 00:01:45 [DEBUG   ] Got command RPT from MCS: ref #229133
2018-10-22 00:01:45 [DEBUG   ] summary = ERROR
2018-10-22 00:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229133  13 58413   105205 A  ERRORERROR'
2018-10-22 00:01:45 [DEBUG   ] Got command RPT from MCS: ref #229134
2018-10-22 00:01:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229134  77 58413   105409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:01:45 [DEBUG   ] Got command RPT from MCS: ref #229135
2018-10-22 00:01:45 [DEBUG   ] summary = ERROR
2018-10-22 00:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229135  13 58413   105613 A  ERRORERROR'
2018-10-22 00:01:45 [DEBUG   ] Got command RPT from MCS: ref #229137
2018-10-22 00:01:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229137  77 58413   105817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:01:46 [DEBUG   ] Got command RPT from MCS: ref #229138
2018-10-22 00:01:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229138  12 58413   106009 A  ERRORB›™š'
2018-10-22 00:01:55 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-22 00:02:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-22 00:02:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 00:02:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:02:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 00:02:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 00:02:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:02:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:02:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:02:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:02:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:02:43 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-10-22 00:02:55 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 00:03:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 00:03:28 [DEBUG   ] Got command RPT from MCS: ref #229147
2018-10-22 00:03:28 [DEBUG   ] summary = ERROR
2018-10-22 00:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229147  13 58413   208733 A  ERRORERROR'
2018-10-22 00:03:28 [DEBUG   ] Got command RPT from MCS: ref #229148
2018-10-22 00:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229148  77 58413   208734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:03:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 00:03:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:03:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:03:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:03:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:03:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:03:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:03:43 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-10-22 00:03:55 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-22 00:04:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 00:04:36 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-22 00:04:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:04:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 00:04:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 00:04:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:04:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:04:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:04:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:04:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:04:43 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-10-22 00:04:56 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-22 00:05:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 00:05:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 00:05:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:05:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 00:05:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:05:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:05:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:05:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:05:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:05:43 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-22 00:05:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 00:06:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 00:06:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 00:06:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:06:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:06:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:06:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:06:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:06:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:06:43 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-22 00:06:45 [DEBUG   ] Got command RPT from MCS: ref #229168
2018-10-22 00:06:45 [DEBUG   ] summary = ERROR
2018-10-22 00:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229168  13 58413   405289 A  ERRORERROR'
2018-10-22 00:06:45 [DEBUG   ] Got command RPT from MCS: ref #229169
2018-10-22 00:06:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229169  77 58413   405493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:06:45 [DEBUG   ] Got command RPT from MCS: ref #229170
2018-10-22 00:06:45 [DEBUG   ] summary = ERROR
2018-10-22 00:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229170  13 58413   405697 A  ERRORERROR'
2018-10-22 00:06:45 [DEBUG   ] Got command RPT from MCS: ref #229171
2018-10-22 00:06:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:06:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229171  77 58413   405889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:06:46 [DEBUG   ] Got command RPT from MCS: ref #229172
2018-10-22 00:06:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229172  12 58413   406093 A  ERRORB›™š'
2018-10-22 00:06:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 00:07:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 00:07:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 00:07:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:07:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:07:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:07:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:07:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:07:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:07:43 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-10-22 00:07:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 00:08:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 00:08:28 [DEBUG   ] Got command RPT from MCS: ref #229173
2018-10-22 00:08:28 [DEBUG   ] summary = ERROR
2018-10-22 00:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229173  13 58413   508737 A  ERRORERROR'
2018-10-22 00:08:28 [DEBUG   ] Got command RPT from MCS: ref #229174
2018-10-22 00:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229174  77 58413   508738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:08:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 00:08:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:08:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:08:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:08:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:08:43 [WARNING ] (13, 1, 'bot')
2018-10-22 00:08:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:08:43 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-22 00:08:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 00:09:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 00:09:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 00:09:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 00:09:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:09:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:09:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:09:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:09:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:09:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:09:44 [DEBUG   ] Finished updating board flags in 2.199 seconds
2018-10-22 00:09:56 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 00:10:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 00:10:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 00:10:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:10:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:10:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:10:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:10:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:10:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:10:44 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-10-22 00:10:57 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 00:11:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 00:11:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 00:11:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:11:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:11:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:11:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:11:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:11:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:11:44 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-22 00:11:45 [DEBUG   ] Got command RPT from MCS: ref #229196
2018-10-22 00:11:45 [DEBUG   ] summary = ERROR
2018-10-22 00:11:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229196  13 58413   705373 A  ERRORERROR'
2018-10-22 00:11:45 [DEBUG   ] Got command RPT from MCS: ref #229197
2018-10-22 00:11:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:11:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229197  77 58413   705565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:11:45 [DEBUG   ] Got command RPT from MCS: ref #229198
2018-10-22 00:11:45 [DEBUG   ] summary = ERROR
2018-10-22 00:11:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229198  13 58413   705769 A  ERRORERROR'
2018-10-22 00:11:45 [DEBUG   ] Got command RPT from MCS: ref #229199
2018-10-22 00:11:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:11:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229199  77 58413   705973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:11:46 [DEBUG   ] Got command RPT from MCS: ref #229201
2018-10-22 00:11:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229201  12 58413   706165 A  ERRORB›™š'
2018-10-22 00:11:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 00:12:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 00:12:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 00:12:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:12:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 00:12:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:12:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:12:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:12:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:12:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:12:44 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-10-22 00:12:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 00:13:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 00:13:28 [DEBUG   ] Got command RPT from MCS: ref #229210
2018-10-22 00:13:28 [DEBUG   ] summary = ERROR
2018-10-22 00:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229210  13 58413   808733 A  ERRORERROR'
2018-10-22 00:13:28 [DEBUG   ] Got command RPT from MCS: ref #229211
2018-10-22 00:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229211  77 58413   808734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:13:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 00:13:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:13:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:13:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:13:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:13:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:13:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:13:44 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-10-22 00:13:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 00:14:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 00:14:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 00:14:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:14:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:14:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:14:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:14:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:14:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:14:44 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-10-22 00:14:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 00:15:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 00:15:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 00:15:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:15:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 00:15:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:15:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:15:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:15:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:15:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:15:44 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-10-22 00:15:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-22 00:16:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 00:16:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 00:16:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:16:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 00:16:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:16:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:16:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:16:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:16:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:16:44 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-10-22 00:16:45 [DEBUG   ] Got command RPT from MCS: ref #229231
2018-10-22 00:16:45 [DEBUG   ] summary = ERROR
2018-10-22 00:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229231  13 58413  1005453 A  ERRORERROR'
2018-10-22 00:16:45 [DEBUG   ] Got command RPT from MCS: ref #229232
2018-10-22 00:16:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229232  77 58413  1005645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:16:45 [DEBUG   ] Got command RPT from MCS: ref #229233
2018-10-22 00:16:45 [DEBUG   ] summary = ERROR
2018-10-22 00:16:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229233  13 58413  1005849 A  ERRORERROR'
2018-10-22 00:16:46 [DEBUG   ] Got command RPT from MCS: ref #229234
2018-10-22 00:16:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:16:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229234  77 58413  1006053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:16:46 [DEBUG   ] Got command RPT from MCS: ref #229235
2018-10-22 00:16:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:16:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229235  12 58413  1006245 A  ERRORB›™š'
2018-10-22 00:16:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 00:17:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 00:17:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 00:17:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:17:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:17:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:17:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:17:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:17:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:17:44 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-22 00:17:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 00:18:18 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 00:18:28 [DEBUG   ] Got command RPT from MCS: ref #229240
2018-10-22 00:18:28 [DEBUG   ] summary = ERROR
2018-10-22 00:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229240  13 58413  1108741 A  ERRORERROR'
2018-10-22 00:18:28 [DEBUG   ] Got command RPT from MCS: ref #229241
2018-10-22 00:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229241  77 58413  1108742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:18:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 00:18:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 00:18:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:18:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 00:18:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:18:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:18:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:18:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:18:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:18:44 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-10-22 00:18:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 00:19:18 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-22 00:19:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 00:19:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:19:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:19:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:19:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:19:44 [WARNING ] (13, 1, 'bot')
2018-10-22 00:19:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:19:44 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-22 00:19:58 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-22 00:20:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 00:20:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 00:20:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:20:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:20:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:20:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:20:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:20:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:20:45 [DEBUG   ] Finished updating board flags in 2.032 seconds
2018-10-22 00:20:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 00:21:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 00:21:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 00:21:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:21:45 [DEBUG   ] Got command RPT from MCS: ref #229263
2018-10-22 00:21:45 [DEBUG   ] summary = ERROR
2018-10-22 00:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229263  13 58413  1305522 A  ERRORERROR'
2018-10-22 00:21:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 00:21:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:21:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:21:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:21:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:21:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:21:45 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-10-22 00:21:45 [DEBUG   ] Got command RPT from MCS: ref #229264
2018-10-22 00:21:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229264  77 58413  1305725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:21:45 [DEBUG   ] Got command RPT from MCS: ref #229265
2018-10-22 00:21:45 [DEBUG   ] summary = ERROR
2018-10-22 00:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229265  13 58413  1305929 A  ERRORERROR'
2018-10-22 00:21:46 [DEBUG   ] Got command RPT from MCS: ref #229267
2018-10-22 00:21:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229267  77 58413  1306133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:21:46 [DEBUG   ] Got command RPT from MCS: ref #229269
2018-10-22 00:21:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229269  12 58413  1306325 A  ERRORB›™š'
2018-10-22 00:21:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 00:22:19 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-22 00:22:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 00:22:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:22:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:22:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:22:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:22:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:22:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:22:45 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-22 00:22:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 00:23:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 00:23:28 [DEBUG   ] Got command RPT from MCS: ref #229273
2018-10-22 00:23:28 [DEBUG   ] summary = ERROR
2018-10-22 00:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229273  13 58413  1408737 A  ERRORERROR'
2018-10-22 00:23:28 [DEBUG   ] Got command RPT from MCS: ref #229274
2018-10-22 00:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229274  77 58413  1408738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:23:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 00:23:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 00:23:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:23:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 00:23:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:23:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:23:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:23:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:23:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:23:45 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-10-22 00:23:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 00:24:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 00:24:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 00:24:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:24:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:24:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:24:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:24:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:24:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:24:45 [DEBUG   ] Finished updating board flags in 1.766 seconds
2018-10-22 00:24:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 00:25:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 00:25:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 00:25:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:25:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 00:25:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:25:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:25:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:25:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:25:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:25:45 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-10-22 00:25:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 00:26:00 [DEBUG   ] Got command TBN from MCS: ref #229294
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-22 00:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   229294   8 58413  1560786 A  ERROR'
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540167962']
2018-10-22 00:26:00 [DEBUG   ] spawn_process: at 2018-10-22 00:26:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540167962']
2018-10-22 00:26:00 [INFO    ] Finished spawning TBN in 0.051 s
2018-10-22 00:26:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 00:26:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 00:26:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:26:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 00:26:45 [DEBUG   ] Got command RPT from MCS: ref #229295
2018-10-22 00:26:45 [DEBUG   ] summary = ERROR
2018-10-22 00:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229295  13 58413  1605610 A  ERRORERROR'
2018-10-22 00:26:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:26:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:26:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:26:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:26:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:26:45 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-22 00:26:45 [DEBUG   ] Got command RPT from MCS: ref #229296
2018-10-22 00:26:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229296  77 58413  1605801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:26:46 [DEBUG   ] Got command RPT from MCS: ref #229297
2018-10-22 00:26:46 [DEBUG   ] summary = ERROR
2018-10-22 00:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229297  13 58413  1606005 A  ERRORERROR'
2018-10-22 00:26:46 [DEBUG   ] Got command RPT from MCS: ref #229298
2018-10-22 00:26:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229298  77 58413  1606209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:26:46 [DEBUG   ] Got command RPT from MCS: ref #229299
2018-10-22 00:26:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229299  12 58413  1606413 A  ERRORB›™š'
2018-10-22 00:27:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 00:27:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-22 00:27:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 00:27:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:27:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:27:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:27:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:27:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:27:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:27:45 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-22 00:28:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 00:28:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 00:28:28 [DEBUG   ] Got command RPT from MCS: ref #229304
2018-10-22 00:28:28 [DEBUG   ] summary = ERROR
2018-10-22 00:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229304  13 58413  1708745 A  ERRORERROR'
2018-10-22 00:28:28 [DEBUG   ] Got command RPT from MCS: ref #229305
2018-10-22 00:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229305  77 58413  1708746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:28:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 00:28:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:28:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 00:28:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:28:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:28:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:28:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:28:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:28:45 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-22 00:29:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 00:29:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 00:29:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 00:29:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:29:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 00:29:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:29:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:29:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:29:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:29:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:29:45 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-10-22 00:30:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 00:30:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 00:30:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 00:30:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:30:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:30:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:30:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:30:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:30:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:30:45 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-22 00:31:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 00:31:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 00:31:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 00:31:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:31:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:31:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:31:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:31:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:31:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:31:45 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-22 00:31:45 [DEBUG   ] Got command RPT from MCS: ref #229327
2018-10-22 00:31:45 [DEBUG   ] summary = ERROR
2018-10-22 00:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229327  13 58413  1905689 A  ERRORERROR'
2018-10-22 00:31:45 [DEBUG   ] Got command RPT from MCS: ref #229328
2018-10-22 00:31:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:31:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229328  77 58413  1905881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:31:46 [DEBUG   ] Got command RPT from MCS: ref #229329
2018-10-22 00:31:46 [DEBUG   ] summary = ERROR
2018-10-22 00:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229329  13 58413  1906085 A  ERRORERROR'
2018-10-22 00:31:46 [DEBUG   ] Got command RPT from MCS: ref #229331
2018-10-22 00:31:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229331  77 58413  1906289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:31:46 [DEBUG   ] Got command RPT from MCS: ref #229332
2018-10-22 00:31:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229332  12 58413  1906493 A  ERRORB›™š'
2018-10-22 00:32:01 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-22 00:32:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-22 00:32:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 00:32:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:32:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:32:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:32:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:32:45 [WARNING ] (13, 1, 'bot')
2018-10-22 00:32:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:32:45 [DEBUG   ] Finished updating board flags in 1.349 seconds
2018-10-22 00:33:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 00:33:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 00:33:28 [DEBUG   ] Got command RPT from MCS: ref #229341
2018-10-22 00:33:28 [DEBUG   ] summary = ERROR
2018-10-22 00:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229341  13 58413  2008741 A  ERRORERROR'
2018-10-22 00:33:28 [DEBUG   ] Got command RPT from MCS: ref #229342
2018-10-22 00:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229342  77 58413  2008742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:33:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 00:33:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:33:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 00:33:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 00:33:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:33:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:33:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:33:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:33:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:33:46 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-10-22 00:34:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 00:34:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 00:34:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 00:34:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:34:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:34:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:34:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:34:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:34:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:34:46 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-10-22 00:35:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 00:35:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 00:35:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 00:35:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:35:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:35:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:35:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:35:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:35:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:35:46 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-22 00:36:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-10-22 00:36:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 00:36:41 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 00:36:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:36:45 [DEBUG   ] Got command RPT from MCS: ref #229362
2018-10-22 00:36:45 [DEBUG   ] summary = ERROR
2018-10-22 00:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229362  13 58413  2205761 A  ERRORERROR'
2018-10-22 00:36:45 [DEBUG   ] Got command RPT from MCS: ref #229363
2018-10-22 00:36:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:36:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229363  77 58413  2205965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:36:46 [DEBUG   ] Got command RPT from MCS: ref #229364
2018-10-22 00:36:46 [DEBUG   ] summary = ERROR
2018-10-22 00:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229364  13 58413  2206170 A  ERRORERROR'
2018-10-22 00:36:46 [DEBUG   ] Got command RPT from MCS: ref #229365
2018-10-22 00:36:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229365  77 58413  2206374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:36:46 [DEBUG   ] Got command RPT from MCS: ref #229366
2018-10-22 00:36:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229366  12 58413  2206566 A  ERRORB›™š'
2018-10-22 00:36:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:36:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:36:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:36:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:36:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:36:46 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-22 00:37:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-22 00:37:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 00:37:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 00:37:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:37:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:37:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:37:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:37:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:37:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:37:46 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-10-22 00:38:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 00:38:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-22 00:38:28 [DEBUG   ] Got command RPT from MCS: ref #229367
2018-10-22 00:38:28 [DEBUG   ] summary = ERROR
2018-10-22 00:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229367  13 58413  2308749 A  ERRORERROR'
2018-10-22 00:38:28 [DEBUG   ] Got command RPT from MCS: ref #229368
2018-10-22 00:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229368  77 58413  2308750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:38:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 00:38:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:38:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 00:38:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:38:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:38:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:38:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:38:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:38:46 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-10-22 00:39:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 00:39:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 00:39:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 00:39:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:39:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 00:39:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:39:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:39:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:39:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:39:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:39:46 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-10-22 00:40:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 00:40:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 00:40:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 00:40:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:40:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:40:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:40:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:40:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:40:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:40:46 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-22 00:41:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 00:41:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 00:41:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 00:41:45 [DEBUG   ] Got command RPT from MCS: ref #229390
2018-10-22 00:41:45 [DEBUG   ] summary = ERROR
2018-10-22 00:41:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229390  13 58413  2505846 A  ERRORERROR'
2018-10-22 00:41:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:41:46 [DEBUG   ] Got command RPT from MCS: ref #229391
2018-10-22 00:41:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229391  77 58413  2506050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:41:46 [DEBUG   ] Got command RPT from MCS: ref #229392
2018-10-22 00:41:46 [DEBUG   ] summary = ERROR
2018-10-22 00:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229392  13 58413  2506253 A  ERRORERROR'
2018-10-22 00:41:46 [DEBUG   ] Got command RPT from MCS: ref #229394
2018-10-22 00:41:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229394  77 58413  2506445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:41:46 [DEBUG   ] Got command RPT from MCS: ref #229395
2018-10-22 00:41:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229395  12 58413  2506649 A  ERRORB›™š'
2018-10-22 00:41:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:41:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:41:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:41:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:41:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:41:46 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-22 00:42:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 00:42:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 00:42:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 00:42:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:42:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:42:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:42:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:42:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:42:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:42:46 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-10-22 00:43:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 00:43:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 00:43:28 [DEBUG   ] Got command RPT from MCS: ref #229404
2018-10-22 00:43:28 [DEBUG   ] summary = ERROR
2018-10-22 00:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229404  13 58413  2608741 A  ERRORERROR'
2018-10-22 00:43:28 [DEBUG   ] Got command RPT from MCS: ref #229405
2018-10-22 00:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229405  77 58413  2608742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:43:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 00:43:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:43:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:43:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:43:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:43:46 [WARNING ] (13, 1, 'bot')
2018-10-22 00:43:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:43:46 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-10-22 00:44:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 00:44:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 00:44:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 00:44:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:44:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:44:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:44:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:44:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:44:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:44:47 [DEBUG   ] Finished updating board flags in 2.134 seconds
2018-10-22 00:45:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 00:45:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 00:45:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 00:45:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:45:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:45:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:45:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:45:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:45:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:45:47 [DEBUG   ] Finished updating board flags in 1.914 seconds
2018-10-22 00:46:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 00:46:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 00:46:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 00:46:45 [DEBUG   ] Got command RPT from MCS: ref #229425
2018-10-22 00:46:45 [DEBUG   ] summary = ERROR
2018-10-22 00:46:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229425  13 58413  2805933 A  ERRORERROR'
2018-10-22 00:46:46 [DEBUG   ] Got command RPT from MCS: ref #229426
2018-10-22 00:46:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:46:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229426  77 58413  2806126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:46:46 [DEBUG   ] Got command RPT from MCS: ref #229427
2018-10-22 00:46:46 [DEBUG   ] summary = ERROR
2018-10-22 00:46:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229427  13 58413  2806330 A  ERRORERROR'
2018-10-22 00:46:46 [DEBUG   ] Got command RPT from MCS: ref #229428
2018-10-22 00:46:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:46:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229428  77 58413  2806534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:46:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:46:46 [DEBUG   ] Got command RPT from MCS: ref #229429
2018-10-22 00:46:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:46:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229429  12 58413  2806725 A  ERRORB‘™š'
2018-10-22 00:46:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:46:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:46:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:46:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:46:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:46:47 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-22 00:47:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 00:47:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 00:47:44 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-22 00:47:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:47:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 00:47:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 00:47:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 00:47:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:47:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:47:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:47:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:47:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:47:47 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-22 00:48:04 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 00:48:23 [DEBUG   ] Finished updating ant stats in 0.409 seconds
2018-10-22 00:48:28 [DEBUG   ] Got command RPT from MCS: ref #229434
2018-10-22 00:48:28 [DEBUG   ] summary = ERROR
2018-10-22 00:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229434  13 58413  2908745 A  ERRORERROR'
2018-10-22 00:48:28 [DEBUG   ] Got command RPT from MCS: ref #229435
2018-10-22 00:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229435  77 58413  2908746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:48:44 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-22 00:48:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 00:48:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:48:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 00:48:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:48:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:48:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:48:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:48:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:48:47 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-22 00:49:04 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-22 00:49:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 00:49:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 00:49:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:49:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:49:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:49:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:49:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:49:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:49:47 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-22 00:50:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 00:50:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 00:50:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 00:50:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:50:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 00:50:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:50:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:50:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:50:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:50:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:50:47 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-10-22 00:51:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 00:51:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 00:51:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 00:51:46 [DEBUG   ] Got command RPT from MCS: ref #229457
2018-10-22 00:51:46 [DEBUG   ] summary = ERROR
2018-10-22 00:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229457  13 58413  3106009 A  ERRORERROR'
2018-10-22 00:51:46 [DEBUG   ] Got command RPT from MCS: ref #229458
2018-10-22 00:51:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229458  77 58413  3106213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:51:46 [DEBUG   ] Got command RPT from MCS: ref #229459
2018-10-22 00:51:46 [DEBUG   ] summary = ERROR
2018-10-22 00:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229459  13 58413  3106405 A  ERRORERROR'
2018-10-22 00:51:46 [DEBUG   ] Got command RPT from MCS: ref #229461
2018-10-22 00:51:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229461  77 58413  3106610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:51:46 [DEBUG   ] Got command RPT from MCS: ref #229462
2018-10-22 00:51:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229462  12 58413  3106806 A  ERRORB’™š'
2018-10-22 00:51:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:51:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:51:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:51:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:51:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:51:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:51:47 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-22 00:52:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 00:52:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 00:52:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 00:52:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:52:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:52:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:52:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:52:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:52:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:52:47 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-10-22 00:53:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-22 00:53:25 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-22 00:53:28 [DEBUG   ] Got command RPT from MCS: ref #229467
2018-10-22 00:53:28 [DEBUG   ] summary = ERROR
2018-10-22 00:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229467  13 58413  3208753 A  ERRORERROR'
2018-10-22 00:53:28 [DEBUG   ] Got command RPT from MCS: ref #229468
2018-10-22 00:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229468  77 58413  3208754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:53:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 00:53:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 00:53:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:53:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 00:53:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 00:53:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:53:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:53:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:53:47 [WARNING ] (13, 1, 'bot')
2018-10-22 00:53:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:53:47 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-22 00:54:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 00:54:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 00:54:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 00:54:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:54:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:54:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:54:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:54:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:54:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:54:48 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-10-22 00:55:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 00:55:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 00:55:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 00:55:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:55:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 00:55:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:55:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:55:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:55:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:55:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:55:48 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-22 00:56:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 00:56:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 00:56:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 00:56:46 [DEBUG   ] Got command RPT from MCS: ref #229488
2018-10-22 00:56:46 [DEBUG   ] summary = ERROR
2018-10-22 00:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229488  13 58413  3406081 A  ERRORERROR'
2018-10-22 00:56:46 [DEBUG   ] Got command RPT from MCS: ref #229489
2018-10-22 00:56:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229489  77 58413  3406285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:56:46 [DEBUG   ] Got command RPT from MCS: ref #229490
2018-10-22 00:56:46 [DEBUG   ] summary = ERROR
2018-10-22 00:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229490  13 58413  3406489 A  ERRORERROR'
2018-10-22 00:56:46 [DEBUG   ] Got command RPT from MCS: ref #229491
2018-10-22 00:56:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229491  77 58413  3406693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:56:46 [DEBUG   ] Got command RPT from MCS: ref #229492
2018-10-22 00:56:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 00:56:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229492  12 58413  3406885 A  ERRORB›™š'
2018-10-22 00:56:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 00:56:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:56:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 00:56:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 00:56:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:56:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:56:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:56:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:56:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:56:48 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-10-22 00:57:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-22 00:57:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 00:57:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 00:57:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:57:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 00:57:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:57:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:57:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:57:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:57:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:57:48 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-22 00:58:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 00:58:25 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 00:58:28 [DEBUG   ] Got command RPT from MCS: ref #229497
2018-10-22 00:58:28 [DEBUG   ] summary = ERROR
2018-10-22 00:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229497  13 58413  3508745 A  ERRORERROR'
2018-10-22 00:58:28 [DEBUG   ] Got command RPT from MCS: ref #229498
2018-10-22 00:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 00:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229498  77 58413  3508746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 00:58:46 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2018-10-22 00:58:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:58:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:58:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:58:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:58:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:58:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:58:48 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-22 00:59:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 00:59:26 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-22 00:59:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-22 00:59:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 00:59:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 00:59:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 00:59:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:59:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:59:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:59:48 [WARNING ] (13, 1, 'bot')
2018-10-22 00:59:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 00:59:48 [DEBUG   ] Finished updating board flags in 1.908 seconds
2018-10-22 01:00:06 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-22 01:00:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-22 01:00:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 01:00:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 01:00:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:00:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 01:00:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:00:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:00:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:00:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:00:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:00:48 [DEBUG   ] Finished updating board flags in 1.683 seconds
2018-10-22 01:01:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 01:01:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 01:01:46 [DEBUG   ] Got command RPT from MCS: ref #229520
2018-10-22 01:01:46 [DEBUG   ] summary = ERROR
2018-10-22 01:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229520  13 58413  3706173 A  ERRORERROR'
2018-10-22 01:01:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 01:01:46 [DEBUG   ] Got command RPT from MCS: ref #229521
2018-10-22 01:01:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 01:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229521  77 58413  3706365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 01:01:46 [DEBUG   ] Got command RPT from MCS: ref #229522
2018-10-22 01:01:46 [DEBUG   ] summary = ERROR
2018-10-22 01:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229522  13 58413  3706569 A  ERRORERROR'
2018-10-22 01:01:46 [DEBUG   ] Got command RPT from MCS: ref #229524
2018-10-22 01:01:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 01:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229524  77 58413  3706773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 01:01:46 [DEBUG   ] Got command RPT from MCS: ref #229525
2018-10-22 01:01:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 01:01:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229525  12 58413  3706977 A  ERRORB›™š'
2018-10-22 01:01:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:01:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 01:01:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:01:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:01:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:01:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:01:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:01:48 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-10-22 01:02:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 01:02:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 01:02:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 01:02:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:02:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:02:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:02:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:02:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:02:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:02:48 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-22 01:03:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 01:03:26 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-22 01:03:28 [DEBUG   ] Got command RPT from MCS: ref #229534
2018-10-22 01:03:28 [DEBUG   ] summary = ERROR
2018-10-22 01:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229534  13 58413  3808745 A  ERRORERROR'
2018-10-22 01:03:28 [DEBUG   ] Got command RPT from MCS: ref #229535
2018-10-22 01:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 01:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229535  77 58413  3808746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 01:03:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 01:03:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 01:03:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:03:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:03:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:03:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:03:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:03:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:03:48 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-22 01:04:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 01:04:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 01:04:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 01:04:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:04:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:04:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:04:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:04:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:04:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:04:48 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-10-22 01:05:06 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-22 01:05:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 01:05:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 01:05:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:05:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:05:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:05:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:05:48 [WARNING ] (13, 1, 'bot')
2018-10-22 01:05:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:05:48 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-10-22 01:06:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 01:06:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 01:06:46 [DEBUG   ] Got command RPT from MCS: ref #229555
2018-10-22 01:06:46 [DEBUG   ] summary = ERROR
2018-10-22 01:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229555  13 58413  4006245 A  ERRORERROR'
2018-10-22 01:06:46 [DEBUG   ] Got command RPT from MCS: ref #229556
2018-10-22 01:06:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 01:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229556  77 58413  4006449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 01:06:46 [DEBUG   ] Got command RPT from MCS: ref #229557
2018-10-22 01:06:46 [DEBUG   ] summary = ERROR
2018-10-22 01:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229557  13 58413  4006653 A  ERRORERROR'
2018-10-22 01:06:46 [DEBUG   ] Got command RPT from MCS: ref #229558
2018-10-22 01:06:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 01:06:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229558  77 58413  4006845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 01:06:47 [DEBUG   ] Got command RPT from MCS: ref #229559
2018-10-22 01:06:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 01:06:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229559  12 58413  4007049 A  ERRORB›™š'
2018-10-22 01:06:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 01:06:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:06:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:06:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:06:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:06:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:06:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:06:49 [DEBUG   ] Finished updating board flags in 2.043 seconds
2018-10-22 01:07:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 01:07:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 01:07:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 01:07:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 01:07:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:07:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 01:07:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 01:07:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:07:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:07:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:07:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:07:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:07:49 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-22 01:08:07 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-22 01:08:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 01:08:28 [DEBUG   ] Got command RPT from MCS: ref #229560
2018-10-22 01:08:28 [DEBUG   ] summary = ERROR
2018-10-22 01:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229560  13 58413  4108745 A  ERRORERROR'
2018-10-22 01:08:28 [DEBUG   ] Got command RPT from MCS: ref #229561
2018-10-22 01:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 01:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229561  77 58413  4108746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 01:08:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 01:08:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:08:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:08:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:08:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:08:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:08:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:08:49 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-22 01:09:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 01:09:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 01:09:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 01:09:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:09:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:09:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:09:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:09:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:09:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:09:49 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-22 01:10:08 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-22 01:10:28 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-22 01:10:48 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2018-10-22 01:10:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:10:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 01:10:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:10:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:10:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:10:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:10:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:10:49 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-10-22 01:11:08 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-10-22 01:11:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 01:11:46 [DEBUG   ] Got command RPT from MCS: ref #229583
2018-10-22 01:11:46 [DEBUG   ] summary = ERROR
2018-10-22 01:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229583  13 58413  4306333 A  ERRORERROR'
2018-10-22 01:11:46 [DEBUG   ] Got command RPT from MCS: ref #229584
2018-10-22 01:11:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 01:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229584  77 58413  4306525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 01:11:46 [DEBUG   ] Got command RPT from MCS: ref #229585
2018-10-22 01:11:46 [DEBUG   ] summary = ERROR
2018-10-22 01:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229585  13 58413  4306729 A  ERRORERROR'
2018-10-22 01:11:46 [DEBUG   ] Got command RPT from MCS: ref #229587
2018-10-22 01:11:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 01:11:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229587  77 58413  4306933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 01:11:47 [DEBUG   ] Got command RPT from MCS: ref #229588
2018-10-22 01:11:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 01:11:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229588  12 58413  4307137 A  ERRORBš™š'
2018-10-22 01:11:48 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-10-22 01:11:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:11:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 01:11:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 01:11:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:11:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:11:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:11:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:11:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:11:49 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-10-22 01:12:08 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-10-22 01:12:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 01:12:48 [DEBUG   ] Finished updating ant stats in 0.852 seconds
2018-10-22 01:12:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:12:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:12:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:12:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:12:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:12:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:12:49 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-22 01:13:08 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-10-22 01:13:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 01:13:28 [DEBUG   ] Got command RPT from MCS: ref #229597
2018-10-22 01:13:28 [DEBUG   ] summary = ERROR
2018-10-22 01:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229597  13 58413  4408753 A  ERRORERROR'
2018-10-22 01:13:28 [DEBUG   ] Got command RPT from MCS: ref #229598
2018-10-22 01:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 01:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229598  77 58413  4408754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 01:13:48 [DEBUG   ] Finished updating ant stats in 0.450 seconds
2018-10-22 01:13:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:13:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 01:13:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:13:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:13:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:13:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:13:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:13:49 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-22 01:14:09 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2018-10-22 01:14:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 01:14:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 01:14:49 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-10-22 01:14:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 01:14:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:14:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:14:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:14:49 [WARNING ] (13, 1, 'bot')
2018-10-22 01:14:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 01:14:49 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-10-22 01:14:59 [DEBUG   ] Got command RPT from MCS: ref #229618
2018-10-22 01:14:59 [DEBUG   ] summary = ERROR
2018-10-22 01:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229618  13 58413  4499581 A  ERRORERROR'
2018-10-22 01:14:59 [DEBUG   ] Got command SHT from MCS: ref #229620
2018-10-22 01:14:59 [DEBUG   ] Stopping antenna statistics
2018-10-22 01:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_SHT   229620   8 58413  4499981 ASHUTDWN'
2018-10-22 01:15:01 [DEBUG   ] Stopping beam statistics
2018-10-22 01:15:01 [DEBUG   ] Stopping monitoring flags
2018-10-22 01:15:01 [DEBUG   ] Stopping BAM updater
2018-10-22 01:15:02 [DEBUG   ] Stopping DRX time setter
2018-10-22 01:15:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 01:15:13 [DEBUG   ] run_process: at 2018-10-22 01:15:13 running ['/usr/local/bin/lwa16', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:13 [DEBUG   ] run_process: at 2018-10-22 01:15:13 running ['/usr/local/bin/lwa27', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:13 [DEBUG   ] run_process: at 2018-10-22 01:15:13 running ['/usr/local/bin/lwa24', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:13 [DEBUG   ] run_process: at 2018-10-22 01:15:13 running ['/usr/local/bin/lwa23', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:13 [DEBUG   ] run_process: at 2018-10-22 01:15:13 running ['/usr/local/bin/lwa18', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:13 [DEBUG   ] run_process: at 2018-10-22 01:15:13 running ['/usr/local/bin/lwa10', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:14 [DEBUG   ] run_process: at 2018-10-22 01:15:14 running ['/usr/local/bin/lwa32', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:14 [DEBUG   ] run_process: at 2018-10-22 01:15:14 running ['/usr/local/bin/lwa11', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:14 [DEBUG   ] run_process: at 2018-10-22 01:15:14 running ['/usr/local/bin/lwa30', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:14 [DEBUG   ] run_process: at 2018-10-22 01:15:14 running ['/usr/local/bin/lwa12', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:14 [DEBUG   ] run_process: at 2018-10-22 01:15:14 running ['/usr/local/bin/lwa8', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:14 [DEBUG   ] run_process: at 2018-10-22 01:15:14 running ['/usr/local/bin/lwa13', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:14 [DEBUG   ] run_process: at 2018-10-22 01:15:14 running ['/usr/local/bin/lwa26', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:14 [DEBUG   ] run_process: at 2018-10-22 01:15:14 running ['/usr/local/bin/lwa14', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:15 [DEBUG   ] run_process: at 2018-10-22 01:15:15 running ['/usr/local/bin/lwa34', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:15 [DEBUG   ] run_process: at 2018-10-22 01:15:15 running ['/usr/local/bin/lwa22', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:15 [DEBUG   ] run_process: at 2018-10-22 01:15:15 running ['/usr/local/bin/lwa20', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:15 [DEBUG   ] run_process: at 2018-10-22 01:15:15 running ['/usr/local/bin/lwa1', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:15 [DEBUG   ] run_process: at 2018-10-22 01:15:15 running ['/usr/local/bin/lwa5', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:15 [DEBUG   ] run_process: at 2018-10-22 01:15:15 running ['/usr/local/bin/lwa25', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:15 [DEBUG   ] run_process: at 2018-10-22 01:15:15 running ['/usr/local/bin/lwa35', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:15 [DEBUG   ] run_process: at 2018-10-22 01:15:15 running ['/usr/local/bin/lwa19', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:15 [DEBUG   ] run_process: at 2018-10-22 01:15:15 running ['/usr/local/bin/lwa21', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:16 [DEBUG   ] run_process: at 2018-10-22 01:15:16 running ['/usr/local/bin/lwa6', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:16 [DEBUG   ] run_process: at 2018-10-22 01:15:16 running ['/usr/local/bin/lwa7', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:16 [DEBUG   ] run_process: at 2018-10-22 01:15:16 running ['/usr/local/bin/lwa33', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:16 [DEBUG   ] run_process: at 2018-10-22 01:15:16 running ['/usr/local/bin/lwa15', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:16 [DEBUG   ] run_process: at 2018-10-22 01:15:16 running ['/usr/local/bin/lwa28', '/lwa/software/Shutdown.sh']
2018-10-22 01:15:16 [INFO    ] Finished the SHT process in 16.680 s
2018-10-22 01:16:46 [DEBUG   ] Got command RPT from MCS: ref #229632
2018-10-22 01:16:46 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:16:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229632  15 58413  4606401 ASHUTDWNSHUTDWN'
2018-10-22 01:18:28 [DEBUG   ] Got command RPT from MCS: ref #229647
2018-10-22 01:18:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229647  15 58413  4708753 ASHUTDWNSHUTDWN'
2018-10-22 01:18:28 [DEBUG   ] Got command RPT from MCS: ref #229648
2018-10-22 01:18:28 [DEBUG   ] info = System has been shut down
2018-10-22 01:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229648  33 58413  4708754 ASHUTDWNSystem has been shut down'
2018-10-22 01:21:46 [DEBUG   ] Got command RPT from MCS: ref #229680
2018-10-22 01:21:46 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:21:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229680  15 58413  4906489 ASHUTDWNSHUTDWN'
2018-10-22 01:23:28 [DEBUG   ] Got command RPT from MCS: ref #229686
2018-10-22 01:23:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229686  15 58413  5008753 ASHUTDWNSHUTDWN'
2018-10-22 01:23:28 [DEBUG   ] Got command RPT from MCS: ref #229687
2018-10-22 01:23:28 [DEBUG   ] info = System has been shut down
2018-10-22 01:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229687  33 58413  5008754 ASHUTDWNSystem has been shut down'
2018-10-22 01:26:46 [DEBUG   ] Got command RPT from MCS: ref #229717
2018-10-22 01:26:46 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:26:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229717  15 58413  5206561 ASHUTDWNSHUTDWN'
2018-10-22 01:28:28 [DEBUG   ] Got command RPT from MCS: ref #229732
2018-10-22 01:28:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229732  15 58413  5308753 ASHUTDWNSHUTDWN'
2018-10-22 01:28:28 [DEBUG   ] Got command RPT from MCS: ref #229733
2018-10-22 01:28:28 [DEBUG   ] info = System has been shut down
2018-10-22 01:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229733  33 58413  5308754 ASHUTDWNSystem has been shut down'
2018-10-22 01:31:46 [DEBUG   ] Got command RPT from MCS: ref #229765
2018-10-22 01:31:46 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:31:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229765  15 58413  5506645 ASHUTDWNSHUTDWN'
2018-10-22 01:33:28 [DEBUG   ] Got command RPT from MCS: ref #229785
2018-10-22 01:33:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229785  15 58413  5608754 ASHUTDWNSHUTDWN'
2018-10-22 01:33:28 [DEBUG   ] Got command RPT from MCS: ref #229786
2018-10-22 01:33:28 [DEBUG   ] info = System has been shut down
2018-10-22 01:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229786  33 58413  5608754 ASHUTDWNSystem has been shut down'
2018-10-22 01:36:46 [DEBUG   ] Got command RPT from MCS: ref #229816
2018-10-22 01:36:46 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:36:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229816  15 58413  5806717 ASHUTDWNSHUTDWN'
2018-10-22 01:38:28 [DEBUG   ] Got command RPT from MCS: ref #229817
2018-10-22 01:38:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229817  15 58413  5908754 ASHUTDWNSHUTDWN'
2018-10-22 01:38:28 [DEBUG   ] Got command RPT from MCS: ref #229818
2018-10-22 01:38:28 [DEBUG   ] info = System has been shut down
2018-10-22 01:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229818  33 58413  5908754 ASHUTDWNSystem has been shut down'
2018-10-22 01:41:46 [DEBUG   ] Got command RPT from MCS: ref #229850
2018-10-22 01:41:46 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:41:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229850  15 58413  6106794 ASHUTDWNSHUTDWN'
2018-10-22 01:43:28 [DEBUG   ] Got command RPT from MCS: ref #229870
2018-10-22 01:43:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229870  15 58413  6208757 ASHUTDWNSHUTDWN'
2018-10-22 01:43:28 [DEBUG   ] Got command RPT from MCS: ref #229871
2018-10-22 01:43:28 [DEBUG   ] info = System has been shut down
2018-10-22 01:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229871  33 58413  6208758 ASHUTDWNSystem has been shut down'
2018-10-22 01:46:46 [DEBUG   ] Got command RPT from MCS: ref #229901
2018-10-22 01:46:46 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:46:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229901  15 58413  6406881 ASHUTDWNSHUTDWN'
2018-10-22 01:48:28 [DEBUG   ] Got command RPT from MCS: ref #229916
2018-10-22 01:48:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229916  15 58413  6508761 ASHUTDWNSHUTDWN'
2018-10-22 01:48:28 [DEBUG   ] Got command RPT from MCS: ref #229917
2018-10-22 01:48:28 [DEBUG   ] info = System has been shut down
2018-10-22 01:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229917  33 58413  6508762 ASHUTDWNSystem has been shut down'
2018-10-22 01:51:46 [DEBUG   ] Got command RPT from MCS: ref #229949
2018-10-22 01:51:46 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:51:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229949  15 58413  6706953 ASHUTDWNSHUTDWN'
2018-10-22 01:53:28 [DEBUG   ] Got command RPT from MCS: ref #229955
2018-10-22 01:53:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229955  15 58413  6808761 ASHUTDWNSHUTDWN'
2018-10-22 01:53:28 [DEBUG   ] Got command RPT from MCS: ref #229956
2018-10-22 01:53:28 [DEBUG   ] info = System has been shut down
2018-10-22 01:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229956  33 58413  6808762 ASHUTDWNSystem has been shut down'
2018-10-22 01:56:47 [DEBUG   ] Got command RPT from MCS: ref #229986
2018-10-22 01:56:47 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:56:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   229986  15 58413  7007026 ASHUTDWNSHUTDWN'
2018-10-22 01:58:28 [DEBUG   ] Got command RPT from MCS: ref #230001
2018-10-22 01:58:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 01:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230001  15 58413  7108761 ASHUTDWNSHUTDWN'
2018-10-22 01:58:28 [DEBUG   ] Got command RPT from MCS: ref #230002
2018-10-22 01:58:28 [DEBUG   ] info = System has been shut down
2018-10-22 01:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230002  33 58413  7108762 ASHUTDWNSystem has been shut down'
2018-10-22 02:01:47 [DEBUG   ] Got command RPT from MCS: ref #230035
2018-10-22 02:01:47 [DEBUG   ] summary = SHUTDWN
2018-10-22 02:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230035  15 58413  7307106 ASHUTDWNSHUTDWN'
2018-10-22 02:03:28 [DEBUG   ] Got command RPT from MCS: ref #230056
2018-10-22 02:03:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 02:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230056  15 58413  7408758 ASHUTDWNSHUTDWN'
2018-10-22 02:03:28 [DEBUG   ] Got command RPT from MCS: ref #230057
2018-10-22 02:03:28 [DEBUG   ] info = System has been shut down
2018-10-22 02:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230057  33 58413  7408758 ASHUTDWNSystem has been shut down'
2018-10-22 02:06:47 [DEBUG   ] Got command RPT from MCS: ref #230088
2018-10-22 02:06:47 [DEBUG   ] summary = SHUTDWN
2018-10-22 02:06:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230088  15 58413  7607190 ASHUTDWNSHUTDWN'
2018-10-22 02:08:28 [DEBUG   ] Got command RPT from MCS: ref #230089
2018-10-22 02:08:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 02:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230089  15 58413  7708758 ASHUTDWNSHUTDWN'
2018-10-22 02:08:28 [DEBUG   ] Got command RPT from MCS: ref #230090
2018-10-22 02:08:28 [DEBUG   ] info = System has been shut down
2018-10-22 02:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230090  33 58413  7708758 ASHUTDWNSystem has been shut down'
2018-10-22 02:11:47 [DEBUG   ] Got command RPT from MCS: ref #230123
2018-10-22 02:11:47 [DEBUG   ] summary = SHUTDWN
2018-10-22 02:11:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230123  15 58413  7907261 ASHUTDWNSHUTDWN'
2018-10-22 02:13:28 [DEBUG   ] Got command RPT from MCS: ref #230144
2018-10-22 02:13:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 02:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230144  15 58413  8008769 ASHUTDWNSHUTDWN'
2018-10-22 02:13:28 [DEBUG   ] Got command RPT from MCS: ref #230145
2018-10-22 02:13:28 [DEBUG   ] info = System has been shut down
2018-10-22 02:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230145  33 58413  8008770 ASHUTDWNSystem has been shut down'
2018-10-22 02:16:47 [DEBUG   ] Got command RPT from MCS: ref #230176
2018-10-22 02:16:47 [DEBUG   ] summary = SHUTDWN
2018-10-22 02:16:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230176  15 58413  8207338 ASHUTDWNSHUTDWN'
2018-10-22 02:18:28 [DEBUG   ] Got command RPT from MCS: ref #230192
2018-10-22 02:18:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 02:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230192  15 58413  8308769 ASHUTDWNSHUTDWN'
2018-10-22 02:18:28 [DEBUG   ] Got command RPT from MCS: ref #230193
2018-10-22 02:18:28 [DEBUG   ] info = System has been shut down
2018-10-22 02:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230193  33 58413  8308770 ASHUTDWNSystem has been shut down'
2018-10-22 02:21:47 [DEBUG   ] Got command RPT from MCS: ref #230216
2018-10-22 02:21:47 [DEBUG   ] summary = SHUTDWN
2018-10-22 02:21:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230216  15 58413  8507421 ASHUTDWNSHUTDWN'
2018-10-22 02:22:00 [DEBUG   ] Got command RPT from MCS: ref #230222
2018-10-22 02:22:00 [DEBUG   ] summary = SHUTDWN
2018-10-22 02:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230222  15 58413  8520057 ASHUTDWNSHUTDWN'
2018-10-22 02:22:00 [DEBUG   ] Got command RPT from MCS: ref #230223
2018-10-22 02:22:00 [DEBUG   ] info = System has been shut down
2018-10-22 02:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230223  33 58413  8520058 ASHUTDWNSystem has been shut down'
2018-10-22 02:22:05 [DEBUG   ] Got command INI from MCS: ref #230224
2018-10-22 02:22:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-22 02:22:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   230224   8 58413  8525065 ABOOTING'
2018-10-22 02:22:24 [INFO    ] -------------------
2018-10-22 02:22:24 [INFO    ]  LWA board status
2018-10-22 02:22:24 [INFO    ] -------------------
2018-10-22 02:22:24 [INFO    ] DP 1: 2 lwa27
2018-10-22 02:22:24 [INFO    ] DP 1: 3 lwa24
2018-10-22 02:22:24 [INFO    ] DP 1: 4 lwa23
2018-10-22 02:22:24 [INFO    ] DP 1: 5 lwa18
2018-10-22 02:22:24 [INFO    ] DP 1: 6 lwa10
2018-10-22 02:22:24 [INFO    ] DP 1: 7 lwa32
2018-10-22 02:22:24 [INFO    ] DP 1: 8 lwa11
2018-10-22 02:22:24 [INFO    ] DP 1: 9 lwa30
2018-10-22 02:22:24 [INFO    ] DP 1: 10 lwa12
2018-10-22 02:22:24 [INFO    ] DP 1: 11 lwa8
2018-10-22 02:22:24 [INFO    ] DP 1: 12 lwa13
2018-10-22 02:22:24 [INFO    ] DP 1: 13 lwa26
2018-10-22 02:22:24 [INFO    ] DP 1: 14 lwa14
2018-10-22 02:22:24 [INFO    ] DP 1: 16 lwa22
2018-10-22 02:22:24 [INFO    ] DP 1: 17 lwa20
2018-10-22 02:22:24 [INFO    ] DP 1: 18 lwa1
2018-10-22 02:22:24 [INFO    ] DP 1: 19 lwa5
2018-10-22 02:22:24 [INFO    ] DP 1: 20 lwa25
2018-10-22 02:22:24 [INFO    ] DP 1: 21 lwa35
2018-10-22 02:22:24 [INFO    ] DP 1: 22 lwa19
2018-10-22 02:22:24 [INFO    ] DP 1: 23 lwa21
2018-10-22 02:22:24 [INFO    ] DP 1: 24 lwa6
2018-10-22 02:22:24 [INFO    ] DP 1: 25 lwa7
2018-10-22 02:22:24 [INFO    ] DP 1: 26 lwa33
2018-10-22 02:22:24 [INFO    ] DP 1: 27 lwa15
2018-10-22 02:22:24 [INFO    ] DP 1: 28 lwa28
2018-10-22 02:22:24 [INFO    ] DP 2: 1 lwa16
2018-10-22 02:22:24 [INFO    ] DP 2: 15 lwa34
2018-10-22 02:22:24 [INFO    ] Total of 28 boards
2018-10-22 02:22:24 [INFO    ] Total of 260 stands
2018-10-22 02:22:24 [INFO    ] -------------------
2018-10-22 02:22:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26729
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26730
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26731
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26732
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26733
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26734
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26735
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26736
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26737
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26738
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26739
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26740
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26741
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26742
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26743
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26744
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26745
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26746
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26747
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26748
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26749
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26750
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26751
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26752
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26753
2018-10-22 02:22:31 [DEBUG   ] 2018-10-22 02:22:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 26754
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26729 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26730 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26731 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26732 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26733 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26734 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26735 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26736 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26737 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26738 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26739 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26740 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26741 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26742 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26743 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26744 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26745 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26746 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26747 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26748 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26749 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26750 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26751 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26752 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26753 exited with status 0
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 26754 exited with status 0
2018-10-22 02:22:43 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] spawn_process: at 2018-10-22 02:22:43 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26781
2018-10-22 02:22:43 [DEBUG   ] 2018-10-22 02:22:43 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 26782
2018-10-22 02:22:48 [DEBUG   ] 2018-10-22 02:22:48 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26781 exited with status 0
2018-10-22 02:22:48 [DEBUG   ] 2018-10-22 02:22:48 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 26782 exited with status 0
2018-10-22 02:22:48 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-22 02:22:48 [DEBUG   ] spawn_process: at 2018-10-22 02:22:48 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-22 02:22:48 [DEBUG   ] spawn_process: at 2018-10-22 02:22:48 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-22 02:22:48 [INFO    ] Setting Beam 1 xbars
2018-10-22 02:22:48 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-22 02:22:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-22 02:22:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-22 02:22:49 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-22 02:22:49 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-22 02:22:49 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-22 02:22:49 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-22 02:22:49 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-22 02:22:49 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-22 02:22:49 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-22 02:22:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-22 02:22:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-22 02:22:50 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-22 02:22:50 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-22 02:22:50 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-22 02:22:50 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-22 02:22:50 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-22 02:22:50 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-22 02:22:50 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-22 02:22:50 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-22 02:22:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-22 02:22:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-22 02:22:51 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-22 02:22:51 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-22 02:22:51 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-22 02:22:51 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-22 02:22:51 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-22 02:22:51 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-22 02:22:51 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-22 02:22:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-22 02:22:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-22 02:22:52 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-22 02:22:52 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-22 02:22:52 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-22 02:22:52 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-22 02:22:52 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-22 02:22:52 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-22 02:22:52 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-22 02:22:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-22 02:22:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-22 02:22:53 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-22 02:22:53 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-22 02:22:53 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-22 02:22:53 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-22 02:22:53 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-22 02:22:53 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-22 02:22:53 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-22 02:22:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-22 02:22:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-22 02:22:54 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-22 02:22:54 [INFO    ] Setting Beam 2 xbars
2018-10-22 02:22:54 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-22 02:22:54 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-22 02:22:54 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-22 02:22:54 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-22 02:22:54 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-22 02:22:54 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-22 02:22:54 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-22 02:22:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-22 02:22:55 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-22 02:22:55 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-22 02:22:55 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-22 02:22:55 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-22 02:22:55 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-22 02:22:55 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-22 02:22:55 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-22 02:22:55 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-22 02:22:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-22 02:22:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-22 02:22:56 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-22 02:22:56 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-22 02:22:56 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-22 02:22:56 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-22 02:22:56 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-22 02:22:56 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-22 02:22:56 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-22 02:22:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-22 02:22:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-22 02:22:57 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-22 02:22:57 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-22 02:22:57 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-22 02:22:57 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-22 02:22:57 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-22 02:22:57 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-22 02:22:57 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-22 02:22:57 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-22 02:22:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-22 02:22:58 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-22 02:22:58 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-22 02:22:58 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-22 02:22:58 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-22 02:22:58 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-22 02:22:58 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-22 02:22:58 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-22 02:22:58 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-22 02:22:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-22 02:22:59 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-22 02:22:59 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-22 02:22:59 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-22 02:22:59 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-22 02:22:59 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-22 02:22:59 [INFO    ] Setting Beam 3 xbars
2018-10-22 02:22:59 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-22 02:22:59 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-22 02:22:59 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-22 02:23:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-22 02:23:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-22 02:23:00 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-22 02:23:00 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-22 02:23:00 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-22 02:23:00 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-22 02:23:00 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-22 02:23:00 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-22 02:23:00 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-22 02:23:00 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-22 02:23:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-22 02:23:01 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-22 02:23:01 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-22 02:23:01 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-22 02:23:01 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-22 02:23:01 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-22 02:23:01 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-22 02:23:01 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-22 02:23:01 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-22 02:23:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-22 02:23:02 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-22 02:23:02 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-22 02:23:02 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-22 02:23:02 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-22 02:23:02 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-22 02:23:02 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-22 02:23:02 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-22 02:23:02 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-22 02:23:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-22 02:23:03 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-22 02:23:03 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-22 02:23:03 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-22 02:23:03 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-22 02:23:03 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-22 02:23:03 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-22 02:23:03 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-22 02:23:03 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-22 02:23:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-22 02:23:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-22 02:23:04 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-22 02:23:04 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-22 02:23:04 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-22 02:23:04 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-22 02:23:04 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-22 02:23:04 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-22 02:23:04 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-22 02:23:04 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-22 02:23:05 [INFO    ] Setting Beam 4 xbars
2018-10-22 02:23:05 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-22 02:23:05 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-22 02:23:05 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-22 02:23:05 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-22 02:23:05 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-22 02:23:05 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-22 02:23:05 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-22 02:23:05 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-22 02:23:05 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-22 02:23:06 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-22 02:23:06 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-22 02:23:06 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-22 02:23:06 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-22 02:23:06 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-22 02:23:06 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-22 02:23:06 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-22 02:23:06 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-22 02:23:06 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-22 02:23:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-22 02:23:07 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-22 02:23:07 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-22 02:23:07 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-22 02:23:07 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-22 02:23:07 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-22 02:23:07 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-22 02:23:07 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-22 02:23:07 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-22 02:23:07 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-22 02:23:08 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-22 02:23:08 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-22 02:23:08 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-22 02:23:08 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-22 02:23:08 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-22 02:23:08 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-22 02:23:08 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-22 02:23:08 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-22 02:23:08 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-22 02:23:09 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-22 02:23:09 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-22 02:23:09 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-22 02:23:09 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-22 02:23:09 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-22 02:23:09 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-22 02:23:09 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-22 02:23:09 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-22 02:23:09 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-22 02:23:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-22 02:23:10 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-22 02:23:10 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-22 02:23:10 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-22 02:23:10 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-22 02:23:10 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-22 02:23:10 [INFO    ] All xbars set
2018-10-22 02:23:10 [INFO    ] Setting adder chain routing for all beams
2018-10-22 02:23:15 [INFO    ] Setting beam ids
2018-10-22 02:23:25 [INFO    ] Starting beam delay calibration
2018-10-22 02:23:28 [DEBUG   ] Got command RPT from MCS: ref #230226
2018-10-22 02:23:28 [DEBUG   ] summary = BOOTING
2018-10-22 02:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230226  15 58413  8608765 ABOOTINGBOOTING'
2018-10-22 02:23:28 [DEBUG   ] Got command RPT from MCS: ref #230227
2018-10-22 02:23:28 [DEBUG   ] info = Starting calibration
2018-10-22 02:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230227  28 58413  8608766 ABOOTINGStarting calibration'
2018-10-22 02:23:37 [INFO    ] Beam 1 latency is 5729
2018-10-22 02:23:37 [INFO    ] Beam 2 latency is 5789
2018-10-22 02:23:37 [INFO    ] Beam 3 latency is 5736
2018-10-22 02:23:37 [INFO    ] Beam 4 latency is 5717
2018-10-22 02:23:37 [INFO    ] Stop calibration
2018-10-22 02:23:45 [INFO    ] Beam delay calibration successful
2018-10-22 02:23:45 [INFO    ] Calibration passed
2018-10-22 02:23:45 [DEBUG   ] spawn_process: at 2018-10-22 02:23:45 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-22 02:23:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-22 02:23:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-22 02:23:45 [DEBUG   ] spawn_process: at 2018-10-22 02:23:45 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-22 02:23:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-22 02:23:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-22 02:23:45 [DEBUG   ] spawn_process: at 2018-10-22 02:23:45 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-22 02:23:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-22 02:23:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-22 02:23:45 [DEBUG   ] spawn_process: at 2018-10-22 02:23:45 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-22 02:23:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-22 02:23:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-22 02:23:45 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-10-22 02:23:46 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 271 ms (1540175026.273 s) with PID 28353 and time 1540175027
2018-10-22 02:23:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-10-22 02:23:46 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 358 ms (1540175026.360 s) with PID 28356 and time 1540175027
2018-10-22 02:23:47 [DEBUG   ] Finished updating ant stats in 0.887 seconds
2018-10-22 02:23:47 [INFO    ] Started antennas statistics background thread
2018-10-22 02:23:47 [INFO    ] Started board flags background thread
2018-10-22 02:23:47 [INFO    ] Started BAM background thread
2018-10-22 02:23:47 [INFO    ] Finished the INI process (ref. #230224) in 102.416 s
2018-10-22 02:23:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:23:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2018-10-22 02:23:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:23:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:23:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:23:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:23:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:23:48 [DEBUG   ] Finished updating board flags in 1.064 seconds
2018-10-22 02:24:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 02:24:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 02:24:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 02:24:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:24:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2018-10-22 02:24:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:24:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:24:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:24:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:24:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:24:48 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-10-22 02:25:05 [DEBUG   ] Got command RPT from MCS: ref #230255
2018-10-22 02:25:05 [DEBUG   ] summary = ERROR
2018-10-22 02:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230255  13 58413  8705069 A  ERRORERROR'
2018-10-22 02:25:05 [DEBUG   ] Got command RPT from MCS: ref #230256
2018-10-22 02:25:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230256  77 58413  8705070 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:25:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 02:25:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 02:25:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 02:25:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 02:25:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:25:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:25:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:25:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:25:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:25:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:25:48 [DEBUG   ] Finished updating board flags in 1.025 seconds
2018-10-22 02:26:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 02:26:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:26:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:26:47 [DEBUG   ] Got command RPT from MCS: ref #230300
2018-10-22 02:26:47 [DEBUG   ] summary = ERROR
2018-10-22 02:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230300  13 58413  8807497 A  ERRORERROR'
2018-10-22 02:26:47 [DEBUG   ] Got command RPT from MCS: ref #230301
2018-10-22 02:26:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230301  77 58413  8807689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:26:47 [DEBUG   ] Got command RPT from MCS: ref #230302
2018-10-22 02:26:47 [DEBUG   ] summary = ERROR
2018-10-22 02:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230302  13 58413  8807897 A  ERRORERROR'
2018-10-22 02:26:48 [DEBUG   ] Got command RPT from MCS: ref #230303
2018-10-22 02:26:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230303  77 58413  8808097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:26:48 [DEBUG   ] Got command RPT from MCS: ref #230304
2018-10-22 02:26:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 02:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230304  12 58413  8808301 A  ERRORB‡ÌÍ'
2018-10-22 02:26:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:26:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:26:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:26:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:26:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:26:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:26:49 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-22 02:27:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:27:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:27:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:27:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:27:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-10-22 02:27:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:27:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:27:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:27:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:27:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:27:49 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-10-22 02:28:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:28:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:28:28 [DEBUG   ] Got command RPT from MCS: ref #230309
2018-10-22 02:28:28 [DEBUG   ] summary = ERROR
2018-10-22 02:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230309  13 58413  8908769 A  ERRORERROR'
2018-10-22 02:28:28 [DEBUG   ] Got command RPT from MCS: ref #230310
2018-10-22 02:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230310  77 58413  8908770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:28:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:28:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:28:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:28:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:28:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:28:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:28:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:28:48 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-10-22 02:29:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:29:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:29:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:29:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:29:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 02:29:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:29:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:29:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:29:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:29:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:29:48 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-10-22 02:30:07 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-22 02:30:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 02:30:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 02:30:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:30:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:30:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:30:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:30:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:30:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:30:48 [DEBUG   ] Finished updating board flags in 1.210 seconds
2018-10-22 02:31:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 02:31:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 02:31:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 02:31:47 [DEBUG   ] Got command RPT from MCS: ref #230332
2018-10-22 02:31:47 [DEBUG   ] summary = ERROR
2018-10-22 02:31:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230332  13 58413  9107573 A  ERRORERROR'
2018-10-22 02:31:47 [DEBUG   ] Got command RPT from MCS: ref #230333
2018-10-22 02:31:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:31:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230333  77 58413  9107777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:31:47 [DEBUG   ] Got command RPT from MCS: ref #230334
2018-10-22 02:31:47 [DEBUG   ] summary = ERROR
2018-10-22 02:31:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230334  13 58413  9107969 A  ERRORERROR'
2018-10-22 02:31:48 [DEBUG   ] Got command RPT from MCS: ref #230335
2018-10-22 02:31:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:31:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230335  77 58413  9108173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:31:48 [DEBUG   ] Got command RPT from MCS: ref #230337
2018-10-22 02:31:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 02:31:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230337  12 58413  9108381 A  ERRORB’™š'
2018-10-22 02:31:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:31:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:31:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:31:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:31:48 [WARNING ] (13, 1, 'bot')
2018-10-22 02:31:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:31:48 [DEBUG   ] Finished updating board flags in 1.170 seconds
2018-10-22 02:32:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 02:32:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 02:32:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 02:32:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-10-22 02:32:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:32:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:32:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:32:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:32:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:32:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:32:49 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-10-22 02:33:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 02:33:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 02:33:28 [DEBUG   ] Got command RPT from MCS: ref #230346
2018-10-22 02:33:28 [DEBUG   ] summary = ERROR
2018-10-22 02:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230346  13 58413  9208765 A  ERRORERROR'
2018-10-22 02:33:28 [DEBUG   ] Got command RPT from MCS: ref #230347
2018-10-22 02:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230347  77 58413  9208766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:33:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 02:33:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:33:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 02:33:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:33:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:33:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:33:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:33:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:33:49 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-10-22 02:34:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 02:34:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 02:34:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 02:34:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:34:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:34:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:34:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:34:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:34:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:34:49 [DEBUG   ] Finished updating board flags in 1.266 seconds
2018-10-22 02:35:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 02:35:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 02:35:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 02:35:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:35:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:35:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:35:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:35:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:35:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:35:49 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-10-22 02:36:07 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2018-10-22 02:36:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 02:36:47 [DEBUG   ] Got command RPT from MCS: ref #230367
2018-10-22 02:36:47 [DEBUG   ] summary = ERROR
2018-10-22 02:36:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230367  13 58413  9407657 A  ERRORERROR'
2018-10-22 02:36:47 [DEBUG   ] Got command RPT from MCS: ref #230368
2018-10-22 02:36:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:36:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230368  77 58413  9407849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:36:48 [DEBUG   ] Got command RPT from MCS: ref #230369
2018-10-22 02:36:48 [DEBUG   ] summary = ERROR
2018-10-22 02:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230369  13 58413  9408053 A  ERRORERROR'
2018-10-22 02:36:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 02:36:48 [DEBUG   ] Got command RPT from MCS: ref #230370
2018-10-22 02:36:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230370  77 58413  9408257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:36:48 [DEBUG   ] Got command RPT from MCS: ref #230371
2018-10-22 02:36:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 02:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230371  12 58413  9408461 A  ERRORBˆÌÍ'
2018-10-22 02:36:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:36:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 02:36:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:36:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:36:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:36:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:36:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:36:49 [DEBUG   ] Finished updating board flags in 1.110 seconds
2018-10-22 02:37:00 [DEBUG   ] Got command TBN from MCS: ref #230372
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-22 02:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   230372   8 58413  9420153 A  ERROR'
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540175821']
2018-10-22 02:37:00 [DEBUG   ] spawn_process: at 2018-10-22 02:37:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540175821']
2018-10-22 02:37:00 [INFO    ] Finished spawning TBN in 0.047 s
2018-10-22 02:37:08 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2018-10-22 02:37:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 02:37:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 02:37:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 02:37:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:37:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 02:37:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 02:37:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:37:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:37:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:37:49 [WARNING ] (13, 1, 'bot')
2018-10-22 02:37:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:37:49 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-10-22 02:38:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 02:38:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 02:38:28 [DEBUG   ] Got command RPT from MCS: ref #230373
2018-10-22 02:38:28 [DEBUG   ] summary = ERROR
2018-10-22 02:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230373  13 58413  9508769 A  ERRORERROR'
2018-10-22 02:38:28 [DEBUG   ] Got command RPT from MCS: ref #230374
2018-10-22 02:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230374  77 58413  9508770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:38:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 02:38:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:38:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:38:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:38:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:38:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:38:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:38:50 [DEBUG   ] Finished updating board flags in 2.159 seconds
2018-10-22 02:39:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 02:39:11 [DEBUG   ] Got command TBW from MCS: ref #230395
2018-10-22 02:39:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-22 02:39:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   230395   8 58413  9551213 A  ERROR'
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-22 02:39:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-22 02:39:14 [DEBUG   ] spawn_process: at 2018-10-22 02:39:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-22 02:39:14 [INFO    ] Finished spawning TBW
2018-10-22 02:39:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:39:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:39:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:39:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:39:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:39:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:39:50 [DEBUG   ] Finished updating board flags in 1.843 seconds
2018-10-22 02:40:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:40:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:40:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:40:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:40:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:40:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:40:50 [DEBUG   ] Finished updating board flags in 1.927 seconds
2018-10-22 02:41:02 [INFO    ] __waitForTBW - TBW finished in 108.212 s
2018-10-22 02:41:03 [INFO    ] Started antennas statistics background thread
2018-10-22 02:41:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540176065']
2018-10-22 02:41:03 [DEBUG   ] spawn_process: at 2018-10-22 02:41:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540176065']
2018-10-22 02:41:04 [DEBUG   ] spawn_process: at 2018-10-22 02:41:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540176065']
2018-10-22 02:41:04 [DEBUG   ] spawn_process: at 2018-10-22 02:41:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540176065']
2018-10-22 02:41:04 [DEBUG   ] spawn_process: at 2018-10-22 02:41:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540176065']
2018-10-22 02:41:04 [DEBUG   ] spawn_process: at 2018-10-22 02:41:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540176065']
2018-10-22 02:41:04 [INFO    ] Finished spawning TBN in 0.051 s
2018-10-22 02:41:04 [DEBUG   ] Finished updating ant stats in 1.292 seconds
2018-10-22 02:41:24 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2018-10-22 02:41:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 02:41:47 [DEBUG   ] Got command RPT from MCS: ref #230405
2018-10-22 02:41:47 [DEBUG   ] summary = ERROR
2018-10-22 02:41:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230405  13 58413  9707729 A  ERRORERROR'
2018-10-22 02:41:47 [DEBUG   ] Got command RPT from MCS: ref #230406
2018-10-22 02:41:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:41:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230406  77 58413  9707933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:41:48 [DEBUG   ] Got command RPT from MCS: ref #230407
2018-10-22 02:41:48 [DEBUG   ] summary = ERROR
2018-10-22 02:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230407  13 58413  9708137 A  ERRORERROR'
2018-10-22 02:41:48 [DEBUG   ] Got command RPT from MCS: ref #230409
2018-10-22 02:41:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230409  77 58413  9708341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:41:48 [DEBUG   ] Got command RPT from MCS: ref #230411
2018-10-22 02:41:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 02:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230411  12 58413  9708533 A  ERRORB›™š'
2018-10-22 02:41:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:41:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 02:41:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 02:41:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:41:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:41:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:41:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:41:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:41:50 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-22 02:42:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 02:42:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 02:42:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 02:42:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:42:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:42:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:42:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:42:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:42:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:42:50 [DEBUG   ] Finished updating board flags in 1.645 seconds
2018-10-22 02:43:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 02:43:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 02:43:28 [DEBUG   ] Got command RPT from MCS: ref #230419
2018-10-22 02:43:28 [DEBUG   ] summary = ERROR
2018-10-22 02:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230419  13 58413  9808765 A  ERRORERROR'
2018-10-22 02:43:28 [DEBUG   ] Got command RPT from MCS: ref #230420
2018-10-22 02:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230420  77 58413  9808766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:43:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 02:43:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:43:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-22 02:43:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 02:43:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:43:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:43:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:43:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:43:50 [WARNING ] (25, 5, 'bot')
2018-10-22 02:43:50 [WARNING ] (25, 5, 'bot')
2018-10-22 02:43:50 [WARNING ] (25, 5, 'bot')
2018-10-22 02:43:50 [WARNING ] (25, 5, 'bot')
2018-10-22 02:43:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:43:50 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-10-22 02:44:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 02:44:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 02:44:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 02:44:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:44:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:44:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:44:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:44:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:44:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:44:50 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-22 02:45:04 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-22 02:45:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 02:45:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 02:45:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:45:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:45:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:45:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:45:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:45:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:45:50 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-10-22 02:46:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 02:46:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 02:46:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 02:46:47 [DEBUG   ] Got command RPT from MCS: ref #230440
2018-10-22 02:46:47 [DEBUG   ] summary = ERROR
2018-10-22 02:46:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230440  13 58413 10007813 A  ERRORERROR'
2018-10-22 02:46:48 [DEBUG   ] Got command RPT from MCS: ref #230441
2018-10-22 02:46:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230441  77 58413 10008017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:46:48 [DEBUG   ] Got command RPT from MCS: ref #230442
2018-10-22 02:46:48 [DEBUG   ] summary = ERROR
2018-10-22 02:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230442  13 58413 10008221 A  ERRORERROR'
2018-10-22 02:46:48 [DEBUG   ] Got command RPT from MCS: ref #230443
2018-10-22 02:46:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230443  77 58413 10008413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:46:48 [DEBUG   ] Got command RPT from MCS: ref #230444
2018-10-22 02:46:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 02:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230444  12 58413 10008617 A  ERRORBœ™š'
2018-10-22 02:46:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:46:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 02:46:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:46:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:46:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:46:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:46:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:46:50 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-10-22 02:47:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 02:47:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 02:47:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 02:47:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:47:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:47:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:47:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:47:50 [WARNING ] (13, 1, 'bot')
2018-10-22 02:47:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:47:50 [DEBUG   ] Finished updating board flags in 1.553 seconds
2018-10-22 02:48:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 02:48:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 02:48:28 [DEBUG   ] Got command RPT from MCS: ref #230449
2018-10-22 02:48:28 [DEBUG   ] summary = ERROR
2018-10-22 02:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230449  13 58413 10108765 A  ERRORERROR'
2018-10-22 02:48:28 [DEBUG   ] Got command RPT from MCS: ref #230450
2018-10-22 02:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230450  77 58413 10108766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:48:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 02:48:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:48:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:48:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:48:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:48:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:48:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:48:51 [DEBUG   ] Finished updating board flags in 2.150 seconds
2018-10-22 02:49:04 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-22 02:49:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:49:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 02:49:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:49:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:49:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:49:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:49:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:49:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:49:51 [DEBUG   ] Finished updating board flags in 1.923 seconds
2018-10-22 02:50:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:50:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:50:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:50:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:50:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:50:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:50:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:50:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:50:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:50:51 [DEBUG   ] Finished updating board flags in 1.839 seconds
2018-10-22 02:51:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 02:51:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:51:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:51:47 [DEBUG   ] Got command RPT from MCS: ref #230472
2018-10-22 02:51:47 [DEBUG   ] summary = ERROR
2018-10-22 02:51:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230472  13 58413 10307893 A  ERRORERROR'
2018-10-22 02:51:48 [DEBUG   ] Got command RPT from MCS: ref #230473
2018-10-22 02:51:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:51:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230473  77 58413 10308097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:51:48 [DEBUG   ] Got command RPT from MCS: ref #230474
2018-10-22 02:51:48 [DEBUG   ] summary = ERROR
2018-10-22 02:51:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230474  13 58413 10308301 A  ERRORERROR'
2018-10-22 02:51:48 [DEBUG   ] Got command RPT from MCS: ref #230476
2018-10-22 02:51:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:51:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230476  77 58413 10308493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:51:48 [DEBUG   ] Got command RPT from MCS: ref #230477
2018-10-22 02:51:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 02:51:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230477  12 58413 10308697 A  ERRORBœ™š'
2018-10-22 02:51:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:51:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:51:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:51:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:51:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:51:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:51:51 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-22 02:52:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:52:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 02:52:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:52:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:52:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:52:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:52:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:52:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:52:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:52:51 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-22 02:53:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:53:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 02:53:28 [DEBUG   ] Got command RPT from MCS: ref #230482
2018-10-22 02:53:28 [DEBUG   ] summary = ERROR
2018-10-22 02:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230482  13 58413 10408773 A  ERRORERROR'
2018-10-22 02:53:28 [DEBUG   ] Got command RPT from MCS: ref #230483
2018-10-22 02:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230483  77 58413 10408774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:53:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 02:53:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:53:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 02:53:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:53:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:53:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:53:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:53:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:53:51 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-22 02:54:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:54:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:54:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:54:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:54:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:54:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:54:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:54:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:54:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:54:51 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-10-22 02:55:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 02:55:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:55:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:55:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:55:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:55:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:55:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:55:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:55:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:55:51 [DEBUG   ] Finished updating board flags in 1.724 seconds
2018-10-22 02:56:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:56:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 02:56:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:56:47 [DEBUG   ] Got command RPT from MCS: ref #230503
2018-10-22 02:56:47 [DEBUG   ] summary = ERROR
2018-10-22 02:56:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230503  13 58413 10607977 A  ERRORERROR'
2018-10-22 02:56:48 [DEBUG   ] Got command RPT from MCS: ref #230504
2018-10-22 02:56:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230504  77 58413 10608181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:56:48 [DEBUG   ] Got command RPT from MCS: ref #230505
2018-10-22 02:56:48 [DEBUG   ] summary = ERROR
2018-10-22 02:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230505  13 58413 10608373 A  ERRORERROR'
2018-10-22 02:56:48 [DEBUG   ] Got command RPT from MCS: ref #230506
2018-10-22 02:56:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230506  77 58413 10608577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:56:48 [DEBUG   ] Got command RPT from MCS: ref #230507
2018-10-22 02:56:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 02:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230507  12 58413 10608781 A  ERRORBœ™š'
2018-10-22 02:56:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:56:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:56:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:56:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:56:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:56:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:56:51 [DEBUG   ] Finished updating board flags in 1.638 seconds
2018-10-22 02:57:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:57:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:57:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 02:57:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:57:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:57:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:57:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:57:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:57:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:57:51 [DEBUG   ] Finished updating board flags in 1.641 seconds
2018-10-22 02:58:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:58:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:58:28 [DEBUG   ] Got command RPT from MCS: ref #230512
2018-10-22 02:58:28 [DEBUG   ] summary = ERROR
2018-10-22 02:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230512  13 58413 10708769 A  ERRORERROR'
2018-10-22 02:58:28 [DEBUG   ] Got command RPT from MCS: ref #230513
2018-10-22 02:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 02:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230513  77 58413 10708770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 02:58:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:58:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 02:58:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:58:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 02:58:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:58:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:58:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:58:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:58:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:58:51 [DEBUG   ] Finished updating board flags in 1.533 seconds
2018-10-22 02:59:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 02:59:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 02:59:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 02:59:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 02:59:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:59:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:59:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:59:51 [WARNING ] (13, 1, 'bot')
2018-10-22 02:59:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 02:59:51 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-10-22 03:00:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 03:00:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 03:00:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 03:00:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:00:51 [WARNING ] (13, 1, 'bot')
2018-10-22 03:00:51 [WARNING ] (13, 1, 'bot')
2018-10-22 03:00:51 [WARNING ] (13, 1, 'bot')
2018-10-22 03:00:51 [WARNING ] (13, 1, 'bot')
2018-10-22 03:00:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:00:51 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-10-22 03:01:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 03:01:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 03:01:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 03:01:48 [DEBUG   ] Got command RPT from MCS: ref #230535
2018-10-22 03:01:48 [DEBUG   ] summary = ERROR
2018-10-22 03:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230535  13 58413 10908053 A  ERRORERROR'
2018-10-22 03:01:48 [DEBUG   ] Got command RPT from MCS: ref #230536
2018-10-22 03:01:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230536  77 58413 10908257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:01:48 [DEBUG   ] Got command RPT from MCS: ref #230537
2018-10-22 03:01:48 [DEBUG   ] summary = ERROR
2018-10-22 03:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230537  13 58413 10908461 A  ERRORERROR'
2018-10-22 03:01:48 [DEBUG   ] Got command RPT from MCS: ref #230539
2018-10-22 03:01:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230539  77 58413 10908653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:01:48 [DEBUG   ] Got command RPT from MCS: ref #230540
2018-10-22 03:01:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:01:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230540  12 58413 10908857 A  ERRORBœ™š'
2018-10-22 03:01:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:01:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:01:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:01:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:01:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:01:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:01:52 [DEBUG   ] Finished updating board flags in 2.175 seconds
2018-10-22 03:02:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 03:02:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 03:02:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 03:02:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:02:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:02:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:02:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:02:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:02:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:02:52 [DEBUG   ] Finished updating board flags in 1.930 seconds
2018-10-22 03:03:05 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-22 03:03:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 03:03:28 [DEBUG   ] Got command RPT from MCS: ref #230549
2018-10-22 03:03:28 [DEBUG   ] summary = ERROR
2018-10-22 03:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230549  13 58413 11008773 A  ERRORERROR'
2018-10-22 03:03:28 [DEBUG   ] Got command RPT from MCS: ref #230550
2018-10-22 03:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230550  77 58413 11008774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:03:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 03:03:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:03:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:03:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:03:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:03:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:03:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:03:52 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-10-22 03:04:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 03:04:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 03:04:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 03:04:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:04:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:04:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:04:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:04:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:04:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:04:52 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-10-22 03:05:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 03:05:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:05:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 03:05:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:05:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:05:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:05:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:05:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:05:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:05:52 [DEBUG   ] Finished updating board flags in 1.760 seconds
2018-10-22 03:06:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:06:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:06:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:06:48 [DEBUG   ] Got command RPT from MCS: ref #230570
2018-10-22 03:06:48 [DEBUG   ] summary = ERROR
2018-10-22 03:06:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230570  13 58413 11208137 A  ERRORERROR'
2018-10-22 03:06:48 [DEBUG   ] Got command RPT from MCS: ref #230571
2018-10-22 03:06:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:06:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230571  77 58413 11208329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:06:48 [DEBUG   ] Got command RPT from MCS: ref #230572
2018-10-22 03:06:48 [DEBUG   ] summary = ERROR
2018-10-22 03:06:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230572  13 58413 11208537 A  ERRORERROR'
2018-10-22 03:06:48 [DEBUG   ] Got command RPT from MCS: ref #230573
2018-10-22 03:06:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:06:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230573  77 58413 11208737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:06:48 [DEBUG   ] Got command RPT from MCS: ref #230574
2018-10-22 03:06:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:06:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230574  12 58413 11208941 A  ERRORBœ™š'
2018-10-22 03:06:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:06:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:06:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:06:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:06:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:06:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:06:52 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-22 03:07:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:07:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:07:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:07:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 03:07:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:07:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:07:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:07:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:07:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:07:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:07:52 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-22 03:08:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:08:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:08:28 [DEBUG   ] Got command RPT from MCS: ref #230575
2018-10-22 03:08:28 [DEBUG   ] summary = ERROR
2018-10-22 03:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230575  13 58413 11308777 A  ERRORERROR'
2018-10-22 03:08:28 [DEBUG   ] Got command RPT from MCS: ref #230576
2018-10-22 03:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230576  77 58413 11308778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:08:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:08:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:08:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:08:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:08:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:08:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:08:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:08:52 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-10-22 03:09:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:09:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 03:09:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:09:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:09:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:09:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:09:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:09:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:09:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:09:52 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-10-22 03:10:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:10:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:10:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:10:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 03:10:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:10:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:10:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:10:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:10:52 [WARNING ] (13, 1, 'bot')
2018-10-22 03:10:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:10:52 [DEBUG   ] Finished updating board flags in 1.577 seconds
2018-10-22 03:11:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:11:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:11:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:11:48 [DEBUG   ] Got command RPT from MCS: ref #230598
2018-10-22 03:11:48 [DEBUG   ] summary = ERROR
2018-10-22 03:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230598  13 58413 11508217 A  ERRORERROR'
2018-10-22 03:11:48 [DEBUG   ] Got command RPT from MCS: ref #230599
2018-10-22 03:11:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230599  77 58413 11508409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:11:48 [DEBUG   ] Got command RPT from MCS: ref #230600
2018-10-22 03:11:48 [DEBUG   ] summary = ERROR
2018-10-22 03:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230600  13 58413 11508613 A  ERRORERROR'
2018-10-22 03:11:48 [DEBUG   ] Got command RPT from MCS: ref #230602
2018-10-22 03:11:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230602  77 58413 11508817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:11:49 [DEBUG   ] Got command RPT from MCS: ref #230603
2018-10-22 03:11:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230603  12 58413 11509013 A  ERRORB›™š'
2018-10-22 03:11:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:11:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 03:11:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:11:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:11:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:11:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:11:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:11:53 [DEBUG   ] Finished updating board flags in 2.230 seconds
2018-10-22 03:12:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:12:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 03:12:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:12:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:12:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:12:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:12:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:12:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:12:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:12:53 [DEBUG   ] Finished updating board flags in 2.062 seconds
2018-10-22 03:13:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:13:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:13:28 [DEBUG   ] Got command RPT from MCS: ref #230612
2018-10-22 03:13:28 [DEBUG   ] summary = ERROR
2018-10-22 03:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230612  13 58413 11608777 A  ERRORERROR'
2018-10-22 03:13:28 [DEBUG   ] Got command RPT from MCS: ref #230613
2018-10-22 03:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230613  77 58413 11608778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:13:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:13:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:13:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 03:13:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:13:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:13:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:13:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:13:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:13:53 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-10-22 03:14:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:14:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:14:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:14:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:14:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 03:14:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:14:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:14:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:14:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:14:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:14:53 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-10-22 03:15:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:15:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:15:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:15:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:15:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:15:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:15:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:15:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:15:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:15:53 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-10-22 03:16:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 03:16:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 03:16:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 03:16:48 [DEBUG   ] Got command RPT from MCS: ref #230633
2018-10-22 03:16:48 [DEBUG   ] summary = ERROR
2018-10-22 03:16:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230633  13 58413 11808293 A  ERRORERROR'
2018-10-22 03:16:48 [DEBUG   ] Got command RPT from MCS: ref #230634
2018-10-22 03:16:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:16:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230634  77 58413 11808497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:16:48 [DEBUG   ] Got command RPT from MCS: ref #230635
2018-10-22 03:16:48 [DEBUG   ] summary = ERROR
2018-10-22 03:16:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230635  13 58413 11808701 A  ERRORERROR'
2018-10-22 03:16:48 [DEBUG   ] Got command RPT from MCS: ref #230636
2018-10-22 03:16:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:16:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230636  77 58413 11808893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:16:49 [DEBUG   ] Got command RPT from MCS: ref #230637
2018-10-22 03:16:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230637  12 58413 11809097 A  ERRORB›™š'
2018-10-22 03:16:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:16:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:16:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:16:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:16:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:16:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:16:53 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-10-22 03:17:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:17:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:17:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 03:17:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:17:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 03:17:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:17:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:17:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:17:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:17:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:17:53 [DEBUG   ] Finished updating board flags in 1.668 seconds
2018-10-22 03:18:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:18:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:18:28 [DEBUG   ] Got command RPT from MCS: ref #230642
2018-10-22 03:18:28 [DEBUG   ] summary = ERROR
2018-10-22 03:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230642  13 58413 11908773 A  ERRORERROR'
2018-10-22 03:18:28 [DEBUG   ] Got command RPT from MCS: ref #230643
2018-10-22 03:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230643  77 58413 11908774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:18:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:18:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:18:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:18:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:18:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:18:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:18:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:18:53 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-22 03:19:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 03:19:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 03:19:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:19:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:19:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 03:19:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:19:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:19:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:19:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:19:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:19:53 [DEBUG   ] Finished updating board flags in 1.526 seconds
2018-10-22 03:20:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 03:20:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 03:20:46 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2018-10-22 03:20:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:20:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 03:20:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 03:20:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:20:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:20:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:20:53 [WARNING ] (13, 1, 'bot')
2018-10-22 03:20:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:20:53 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-10-22 03:21:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 03:21:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 03:21:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 03:21:48 [DEBUG   ] Got command RPT from MCS: ref #230665
2018-10-22 03:21:48 [DEBUG   ] summary = ERROR
2018-10-22 03:21:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230665  13 58413 12108369 A  ERRORERROR'
2018-10-22 03:21:48 [DEBUG   ] Got command RPT from MCS: ref #230666
2018-10-22 03:21:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:21:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230666  77 58413 12108573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:21:48 [DEBUG   ] Got command RPT from MCS: ref #230667
2018-10-22 03:21:48 [DEBUG   ] summary = ERROR
2018-10-22 03:21:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230667  13 58413 12108777 A  ERRORERROR'
2018-10-22 03:21:48 [DEBUG   ] Got command RPT from MCS: ref #230669
2018-10-22 03:21:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:21:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230669  77 58413 12108981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:21:49 [DEBUG   ] Got command RPT from MCS: ref #230671
2018-10-22 03:21:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230671  12 58413 12109173 A  ERRORB›™š'
2018-10-22 03:21:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:21:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:21:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:21:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:21:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:21:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:21:54 [DEBUG   ] Finished updating board flags in 2.188 seconds
2018-10-22 03:22:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 03:22:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 03:22:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 03:22:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:22:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:22:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:22:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:22:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:22:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:22:54 [DEBUG   ] Finished updating board flags in 1.965 seconds
2018-10-22 03:23:05 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-22 03:23:25 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 03:23:28 [DEBUG   ] Got command RPT from MCS: ref #230675
2018-10-22 03:23:28 [DEBUG   ] summary = ERROR
2018-10-22 03:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230675  13 58413 12208773 A  ERRORERROR'
2018-10-22 03:23:28 [DEBUG   ] Got command RPT from MCS: ref #230676
2018-10-22 03:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230676  77 58413 12208774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:23:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 03:23:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:23:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:23:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:23:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:23:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:23:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:23:54 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-22 03:24:06 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-22 03:24:25 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 03:24:46 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-22 03:24:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:24:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:24:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:24:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:24:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:24:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:24:54 [DEBUG   ] Finished updating board flags in 1.754 seconds
2018-10-22 03:25:06 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-22 03:25:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 03:25:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 03:25:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:25:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:25:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:25:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:25:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:25:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:25:54 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-22 03:26:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 03:26:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 03:26:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 03:26:48 [DEBUG   ] Got command RPT from MCS: ref #230696
2018-10-22 03:26:48 [DEBUG   ] summary = ERROR
2018-10-22 03:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230696  13 58413 12408449 A  ERRORERROR'
2018-10-22 03:26:48 [DEBUG   ] Got command RPT from MCS: ref #230697
2018-10-22 03:26:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230697  77 58413 12408653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:26:48 [DEBUG   ] Got command RPT from MCS: ref #230698
2018-10-22 03:26:48 [DEBUG   ] summary = ERROR
2018-10-22 03:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230698  13 58413 12408857 A  ERRORERROR'
2018-10-22 03:26:49 [DEBUG   ] Got command RPT from MCS: ref #230699
2018-10-22 03:26:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230699  77 58413 12409061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:26:49 [DEBUG   ] Got command RPT from MCS: ref #230700
2018-10-22 03:26:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230700  12 58413 12409253 A  ERRORBœ™š'
2018-10-22 03:26:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:26:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:26:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:26:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:26:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:26:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:26:54 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-22 03:27:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 03:27:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 03:27:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 03:27:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:27:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:27:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:27:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:27:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:27:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:27:54 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-22 03:28:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 03:28:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 03:28:28 [DEBUG   ] Got command RPT from MCS: ref #230705
2018-10-22 03:28:28 [DEBUG   ] summary = ERROR
2018-10-22 03:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230705  13 58413 12508777 A  ERRORERROR'
2018-10-22 03:28:28 [DEBUG   ] Got command RPT from MCS: ref #230706
2018-10-22 03:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230706  77 58413 12508778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:28:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 03:28:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 03:28:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:28:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:28:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:28:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:28:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:28:54 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-10-22 03:29:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 03:29:26 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-22 03:29:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:29:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:29:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:29:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:29:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:29:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:29:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:29:54 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-10-22 03:30:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 03:30:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:30:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 03:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:30:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:30:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:30:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:30:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:30:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:30:54 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-22 03:31:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 03:31:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:31:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:31:48 [DEBUG   ] Got command RPT from MCS: ref #230728
2018-10-22 03:31:48 [DEBUG   ] summary = ERROR
2018-10-22 03:31:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230728  13 58413 12708537 A  ERRORERROR'
2018-10-22 03:31:48 [DEBUG   ] Got command RPT from MCS: ref #230729
2018-10-22 03:31:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:31:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230729  77 58413 12708729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:31:48 [DEBUG   ] Got command RPT from MCS: ref #230730
2018-10-22 03:31:48 [DEBUG   ] summary = ERROR
2018-10-22 03:31:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230730  13 58413 12708933 A  ERRORERROR'
2018-10-22 03:31:49 [DEBUG   ] Got command RPT from MCS: ref #230732
2018-10-22 03:31:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:31:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230732  77 58413 12709137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:31:49 [DEBUG   ] Got command RPT from MCS: ref #230733
2018-10-22 03:31:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:31:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230733  12 58413 12709341 A  ERRORBœ™š'
2018-10-22 03:31:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:31:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:31:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:31:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:31:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:31:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:31:54 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-10-22 03:32:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:32:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:32:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:32:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:32:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 03:32:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:32:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:32:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:32:54 [WARNING ] (13, 1, 'bot')
2018-10-22 03:32:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:32:54 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-22 03:33:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:33:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:33:28 [DEBUG   ] Got command RPT from MCS: ref #230742
2018-10-22 03:33:28 [DEBUG   ] summary = ERROR
2018-10-22 03:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230742  13 58413 12808785 A  ERRORERROR'
2018-10-22 03:33:28 [DEBUG   ] Got command RPT from MCS: ref #230743
2018-10-22 03:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230743  77 58413 12808786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:33:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 03:33:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 03:33:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:33:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 03:33:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 03:33:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:33:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:33:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:33:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:33:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:33:55 [DEBUG   ] Finished updating board flags in 2.184 seconds
2018-10-22 03:34:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 03:34:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 03:34:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 03:34:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:34:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:34:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:34:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:34:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:34:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:34:55 [DEBUG   ] Finished updating board flags in 1.931 seconds
2018-10-22 03:35:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 03:35:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 03:35:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 03:35:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:35:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 03:35:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:35:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:35:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:35:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:35:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:35:55 [DEBUG   ] Finished updating board flags in 1.838 seconds
2018-10-22 03:36:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 03:36:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 03:36:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 03:36:48 [DEBUG   ] Got command RPT from MCS: ref #230763
2018-10-22 03:36:48 [DEBUG   ] summary = ERROR
2018-10-22 03:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230763  13 58413 13008617 A  ERRORERROR'
2018-10-22 03:36:48 [DEBUG   ] Got command RPT from MCS: ref #230764
2018-10-22 03:36:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230764  77 58413 13008821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:36:49 [DEBUG   ] Got command RPT from MCS: ref #230765
2018-10-22 03:36:49 [DEBUG   ] summary = ERROR
2018-10-22 03:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230765  13 58413 13009013 A  ERRORERROR'
2018-10-22 03:36:49 [DEBUG   ] Got command RPT from MCS: ref #230766
2018-10-22 03:36:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230766  77 58413 13009217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:36:49 [DEBUG   ] Got command RPT from MCS: ref #230767
2018-10-22 03:36:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230767  12 58413 13009421 A  ERRORB›™š'
2018-10-22 03:36:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:36:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 03:36:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:36:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:36:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:36:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:36:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:36:55 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-22 03:37:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 03:37:27 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-22 03:37:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-22 03:37:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:37:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:37:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:37:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:37:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:37:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:37:55 [DEBUG   ] Finished updating board flags in 1.739 seconds
2018-10-22 03:38:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 03:38:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:38:28 [DEBUG   ] Got command RPT from MCS: ref #230768
2018-10-22 03:38:28 [DEBUG   ] summary = ERROR
2018-10-22 03:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230768  13 58413 13108781 A  ERRORERROR'
2018-10-22 03:38:28 [DEBUG   ] Got command RPT from MCS: ref #230769
2018-10-22 03:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230769  77 58413 13108782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:38:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:38:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 03:38:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:38:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:38:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:38:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:38:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:38:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:38:55 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-22 03:39:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:39:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:39:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 03:39:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:39:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:39:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:39:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:39:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:39:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:39:55 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-10-22 03:40:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:40:27 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-22 03:40:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:40:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:40:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:40:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:40:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:40:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:40:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:40:55 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-22 03:41:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:41:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:41:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:41:48 [DEBUG   ] Got command RPT from MCS: ref #230791
2018-10-22 03:41:48 [DEBUG   ] summary = ERROR
2018-10-22 03:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230791  13 58413 13308697 A  ERRORERROR'
2018-10-22 03:41:48 [DEBUG   ] Got command RPT from MCS: ref #230792
2018-10-22 03:41:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230792  77 58413 13308889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:41:49 [DEBUG   ] Got command RPT from MCS: ref #230793
2018-10-22 03:41:49 [DEBUG   ] summary = ERROR
2018-10-22 03:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230793  13 58413 13309093 A  ERRORERROR'
2018-10-22 03:41:49 [DEBUG   ] Got command RPT from MCS: ref #230795
2018-10-22 03:41:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230795  77 58413 13309297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:41:49 [DEBUG   ] Got command RPT from MCS: ref #230796
2018-10-22 03:41:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230796  12 58413 13309501 A  ERRORBœ™š'
2018-10-22 03:41:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:41:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:41:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:41:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:41:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:41:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:41:55 [DEBUG   ] Finished updating board flags in 1.525 seconds
2018-10-22 03:42:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:42:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:42:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 03:42:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:42:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:42:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:42:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:42:55 [WARNING ] (13, 1, 'bot')
2018-10-22 03:42:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:42:55 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-10-22 03:43:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 03:43:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:43:28 [DEBUG   ] Got command RPT from MCS: ref #230805
2018-10-22 03:43:28 [DEBUG   ] summary = ERROR
2018-10-22 03:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230805  13 58413 13408785 A  ERRORERROR'
2018-10-22 03:43:28 [DEBUG   ] Got command RPT from MCS: ref #230806
2018-10-22 03:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230806  77 58413 13408786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:43:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 03:43:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:43:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:43:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:43:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:43:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:43:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:43:56 [DEBUG   ] Finished updating board flags in 2.230 seconds
2018-10-22 03:44:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:44:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:44:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:44:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:44:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:44:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:44:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:44:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:44:56 [DEBUG   ] Finished updating board flags in 2.233 seconds
2018-10-22 03:45:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:45:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:45:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:45:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:45:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:45:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:45:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:45:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:45:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:45:56 [DEBUG   ] Finished updating board flags in 2.077 seconds
2018-10-22 03:46:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:46:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 03:46:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 03:46:48 [DEBUG   ] Got command RPT from MCS: ref #230826
2018-10-22 03:46:48 [DEBUG   ] summary = ERROR
2018-10-22 03:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230826  13 58413 13608777 A  ERRORERROR'
2018-10-22 03:46:48 [DEBUG   ] Got command RPT from MCS: ref #230827
2018-10-22 03:46:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:46:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230827  77 58413 13608969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:46:49 [DEBUG   ] Got command RPT from MCS: ref #230828
2018-10-22 03:46:49 [DEBUG   ] summary = ERROR
2018-10-22 03:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230828  13 58413 13609173 A  ERRORERROR'
2018-10-22 03:46:49 [DEBUG   ] Got command RPT from MCS: ref #230829
2018-10-22 03:46:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230829  77 58413 13609377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:46:49 [DEBUG   ] Got command RPT from MCS: ref #230830
2018-10-22 03:46:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230830  12 58413 13609581 A  ERRORB›™š'
2018-10-22 03:46:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:46:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:46:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:46:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:46:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:46:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:46:56 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-10-22 03:47:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 03:47:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 03:47:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 03:47:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:47:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:47:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:47:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:47:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:47:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:47:56 [DEBUG   ] Finished updating board flags in 1.970 seconds
2018-10-22 03:48:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 03:48:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 03:48:28 [DEBUG   ] Got command RPT from MCS: ref #230835
2018-10-22 03:48:28 [DEBUG   ] summary = ERROR
2018-10-22 03:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230835  13 58413 13708777 A  ERRORERROR'
2018-10-22 03:48:28 [DEBUG   ] Got command RPT from MCS: ref #230836
2018-10-22 03:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230836  77 58413 13708778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:48:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 03:48:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:48:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 03:48:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:48:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:48:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:48:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:48:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:48:56 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-22 03:49:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 03:49:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 03:49:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 03:49:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:49:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:49:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:49:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:49:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:49:56 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-10-22 03:50:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 03:50:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 03:50:48 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:50:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:50:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:50:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:50:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:50:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:50:56 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-22 03:51:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 03:51:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 03:51:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 03:51:48 [DEBUG   ] Got command RPT from MCS: ref #230858
2018-10-22 03:51:48 [DEBUG   ] summary = ERROR
2018-10-22 03:51:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230858  13 58413 13908853 A  ERRORERROR'
2018-10-22 03:51:49 [DEBUG   ] Got command RPT from MCS: ref #230859
2018-10-22 03:51:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:51:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230859  77 58413 13909057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:51:49 [DEBUG   ] Got command RPT from MCS: ref #230860
2018-10-22 03:51:49 [DEBUG   ] summary = ERROR
2018-10-22 03:51:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230860  13 58413 13909249 A  ERRORERROR'
2018-10-22 03:51:49 [DEBUG   ] Got command RPT from MCS: ref #230862
2018-10-22 03:51:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:51:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230862  77 58413 13909453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:51:49 [DEBUG   ] Got command RPT from MCS: ref #230864
2018-10-22 03:51:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:51:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230864  12 58413 13909657 A  ERRORBœ™š'
2018-10-22 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:51:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 03:51:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:51:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:51:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:51:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:51:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:51:56 [DEBUG   ] Finished updating board flags in 1.702 seconds
2018-10-22 03:52:07 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-22 03:52:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 03:52:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 03:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:52:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:52:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:52:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:52:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:52:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:52:56 [DEBUG   ] Finished updating board flags in 1.488 seconds
2018-10-22 03:53:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 03:53:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 03:53:28 [DEBUG   ] Got command RPT from MCS: ref #230868
2018-10-22 03:53:28 [DEBUG   ] summary = ERROR
2018-10-22 03:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230868  13 58413 14008781 A  ERRORERROR'
2018-10-22 03:53:28 [DEBUG   ] Got command RPT from MCS: ref #230869
2018-10-22 03:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230869  77 58413 14008782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:53:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:53:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:53:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:53:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:53:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:53:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:53:56 [DEBUG   ] Finished updating board flags in 1.475 seconds
2018-10-22 03:54:08 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-22 03:54:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:54:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:54:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:54:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:54:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:54:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:54:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:54:56 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-10-22 03:55:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:55:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:55:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:55:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:55:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:55:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:55:56 [WARNING ] (13, 1, 'bot')
2018-10-22 03:55:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:55:56 [DEBUG   ] Finished updating board flags in 1.480 seconds
2018-10-22 03:56:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:56:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:56:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:56:48 [DEBUG   ] Got command RPT from MCS: ref #230889
2018-10-22 03:56:48 [DEBUG   ] summary = ERROR
2018-10-22 03:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230889  13 58413 14208933 A  ERRORERROR'
2018-10-22 03:56:49 [DEBUG   ] Got command RPT from MCS: ref #230890
2018-10-22 03:56:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:56:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230890  77 58413 14209137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:56:49 [DEBUG   ] Got command RPT from MCS: ref #230891
2018-10-22 03:56:49 [DEBUG   ] summary = ERROR
2018-10-22 03:56:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230891  13 58413 14209329 A  ERRORERROR'
2018-10-22 03:56:49 [DEBUG   ] Got command RPT from MCS: ref #230892
2018-10-22 03:56:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:56:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230892  77 58413 14209533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:56:49 [DEBUG   ] Got command RPT from MCS: ref #230893
2018-10-22 03:56:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 03:56:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230893  12 58413 14209737 A  ERRORBœ™š'
2018-10-22 03:56:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:56:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 03:56:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:56:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:56:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:56:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:56:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:56:57 [DEBUG   ] Finished updating board flags in 2.213 seconds
2018-10-22 03:57:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:57:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 03:57:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:57:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:57:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:57:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:57:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:57:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:57:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:57:57 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-10-22 03:58:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:58:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:58:28 [DEBUG   ] Got command RPT from MCS: ref #230898
2018-10-22 03:58:28 [DEBUG   ] summary = ERROR
2018-10-22 03:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230898  13 58413 14308781 A  ERRORERROR'
2018-10-22 03:58:28 [DEBUG   ] Got command RPT from MCS: ref #230899
2018-10-22 03:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 03:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230899  77 58413 14308782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 03:58:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 03:58:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:58:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:58:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:58:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:58:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:58:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:58:57 [DEBUG   ] Finished updating board flags in 2.260 seconds
2018-10-22 03:59:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 03:59:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:59:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 03:59:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 03:59:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 03:59:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 03:59:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:59:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:59:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:59:57 [WARNING ] (13, 1, 'bot')
2018-10-22 03:59:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 03:59:57 [DEBUG   ] Finished updating board flags in 2.153 seconds
2018-10-22 04:00:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 04:00:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 04:00:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:00:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 04:00:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:00:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:00:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:00:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:00:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:00:57 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-10-22 04:01:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:01:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 04:01:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 04:01:49 [DEBUG   ] Got command RPT from MCS: ref #230921
2018-10-22 04:01:49 [DEBUG   ] summary = ERROR
2018-10-22 04:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230921  13 58413 14509013 A  ERRORERROR'
2018-10-22 04:01:49 [DEBUG   ] Got command RPT from MCS: ref #230922
2018-10-22 04:01:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230922  77 58413 14509217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:01:49 [DEBUG   ] Got command RPT from MCS: ref #230923
2018-10-22 04:01:49 [DEBUG   ] summary = ERROR
2018-10-22 04:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230923  13 58413 14509409 A  ERRORERROR'
2018-10-22 04:01:49 [DEBUG   ] Got command RPT from MCS: ref #230925
2018-10-22 04:01:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230925  77 58413 14509613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:01:49 [DEBUG   ] Got command RPT from MCS: ref #230926
2018-10-22 04:01:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230926  12 58413 14509817 A  ERRORB›™š'
2018-10-22 04:01:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:01:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:01:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:01:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:01:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:01:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:01:57 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-22 04:02:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:02:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:02:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 04:02:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:02:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:02:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:02:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:02:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:02:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:02:57 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-22 04:03:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 04:03:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 04:03:28 [DEBUG   ] Got command RPT from MCS: ref #230935
2018-10-22 04:03:28 [DEBUG   ] summary = ERROR
2018-10-22 04:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230935  13 58413 14608789 A  ERRORERROR'
2018-10-22 04:03:28 [DEBUG   ] Got command RPT from MCS: ref #230936
2018-10-22 04:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230936  77 58413 14608790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:03:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:03:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:03:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:03:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:03:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:03:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:03:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:03:57 [DEBUG   ] Finished updating board flags in 1.859 seconds
2018-10-22 04:04:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 04:04:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 04:04:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 04:04:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:04:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:04:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:04:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:04:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:04:57 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-22 04:05:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 04:05:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 04:05:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 04:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 04:05:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:05:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:05:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:05:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:05:57 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-22 04:06:08 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-22 04:06:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:06:49 [DEBUG   ] Got command RPT from MCS: ref #230956
2018-10-22 04:06:49 [DEBUG   ] summary = ERROR
2018-10-22 04:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230956  13 58413 14809089 A  ERRORERROR'
2018-10-22 04:06:49 [DEBUG   ] Got command RPT from MCS: ref #230957
2018-10-22 04:06:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230957  77 58413 14809293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:06:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 04:06:49 [DEBUG   ] Got command RPT from MCS: ref #230958
2018-10-22 04:06:49 [DEBUG   ] summary = ERROR
2018-10-22 04:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230958  13 58413 14809497 A  ERRORERROR'
2018-10-22 04:06:49 [DEBUG   ] Got command RPT from MCS: ref #230959
2018-10-22 04:06:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230959  77 58413 14809689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:06:49 [DEBUG   ] Got command RPT from MCS: ref #230960
2018-10-22 04:06:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:06:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230960  12 58413 14809893 A  ERRORB›™š'
2018-10-22 04:06:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:06:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:06:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:06:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:06:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:06:57 [DEBUG   ] Finished updating board flags in 1.712 seconds
2018-10-22 04:07:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 04:07:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:07:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:07:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:07:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:07:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:07:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:07:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:07:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:07:57 [DEBUG   ] Finished updating board flags in 1.651 seconds
2018-10-22 04:08:00 [DEBUG   ] Got command TBN from MCS: ref #230961
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-22 04:08:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   230961   8 58413 14880605 A  ERROR'
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540181282']
2018-10-22 04:08:00 [DEBUG   ] spawn_process: at 2018-10-22 04:08:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540181282']
2018-10-22 04:08:00 [INFO    ] Finished spawning TBN in 0.050 s
2018-10-22 04:08:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 04:08:28 [DEBUG   ] Got command RPT from MCS: ref #230962
2018-10-22 04:08:28 [DEBUG   ] summary = ERROR
2018-10-22 04:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230962  13 58413 14908785 A  ERRORERROR'
2018-10-22 04:08:28 [DEBUG   ] Got command RPT from MCS: ref #230963
2018-10-22 04:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230963  77 58413 14908786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:08:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 04:08:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:08:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:08:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:08:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:08:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:08:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:08:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:08:57 [DEBUG   ] Finished updating board flags in 1.555 seconds
2018-10-22 04:09:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 04:09:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 04:09:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 04:09:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:09:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 04:09:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 04:09:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:09:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:09:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:09:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:09:57 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-22 04:10:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 04:10:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 04:10:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 04:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:10:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 04:10:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 04:10:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:10:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:10:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:10:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:10:57 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-10-22 04:11:09 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-22 04:11:29 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 04:11:49 [DEBUG   ] Got command RPT from MCS: ref #230985
2018-10-22 04:11:49 [DEBUG   ] summary = ERROR
2018-10-22 04:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230985  13 58413 15109169 A  ERRORERROR'
2018-10-22 04:11:49 [DEBUG   ] Got command RPT from MCS: ref #230986
2018-10-22 04:11:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230986  77 58413 15109373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:11:49 [DEBUG   ] Got command RPT from MCS: ref #230987
2018-10-22 04:11:49 [DEBUG   ] summary = ERROR
2018-10-22 04:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230987  13 58413 15109577 A  ERRORERROR'
2018-10-22 04:11:49 [DEBUG   ] Got command RPT from MCS: ref #230989
2018-10-22 04:11:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230989  77 58413 15109769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:11:49 [DEBUG   ] Got command RPT from MCS: ref #230991
2018-10-22 04:11:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:11:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230991  12 58413 15109973 A  ERRORB›™š'
2018-10-22 04:11:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-22 04:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 04:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 04:11:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:11:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:11:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:11:57 [WARNING ] (13, 1, 'bot')
2018-10-22 04:11:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:11:57 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-10-22 04:12:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 04:12:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 04:12:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:12:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 04:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 04:12:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:12:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:12:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:12:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:12:58 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-10-22 04:13:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:13:28 [DEBUG   ] Got command RPT from MCS: ref #230999
2018-10-22 04:13:28 [DEBUG   ] summary = ERROR
2018-10-22 04:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   230999  13 58413 15208793 A  ERRORERROR'
2018-10-22 04:13:28 [DEBUG   ] Got command RPT from MCS: ref #231000
2018-10-22 04:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231000  77 58413 15208794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:13:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 04:13:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:13:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:13:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:13:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:13:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:13:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:13:58 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-10-22 04:14:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 04:14:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 04:14:50 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-22 04:14:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:14:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:14:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:14:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:14:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:14:58 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-10-22 04:15:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 04:15:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 04:15:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 04:15:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 04:15:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:15:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:15:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:15:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:15:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:15:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:15:58 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-10-22 04:16:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 04:16:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 04:16:49 [DEBUG   ] Got command RPT from MCS: ref #231020
2018-10-22 04:16:49 [DEBUG   ] summary = ERROR
2018-10-22 04:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231020  13 58413 15409245 A  ERRORERROR'
2018-10-22 04:16:49 [DEBUG   ] Got command RPT from MCS: ref #231021
2018-10-22 04:16:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231021  77 58413 15409449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:16:49 [DEBUG   ] Got command RPT from MCS: ref #231022
2018-10-22 04:16:49 [DEBUG   ] summary = ERROR
2018-10-22 04:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231022  13 58413 15409653 A  ERRORERROR'
2018-10-22 04:16:49 [DEBUG   ] Got command RPT from MCS: ref #231023
2018-10-22 04:16:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231023  77 58413 15409857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:16:50 [DEBUG   ] Got command RPT from MCS: ref #231024
2018-10-22 04:16:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231024  12 58413 15410049 A  ERRORB›™š'
2018-10-22 04:16:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 04:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:16:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:16:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:16:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:16:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:16:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:16:58 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-22 04:17:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 04:17:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 04:17:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-22 04:17:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:17:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:17:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:17:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:17:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:17:58 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-22 04:18:11 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-22 04:18:28 [DEBUG   ] Got command RPT from MCS: ref #231029
2018-10-22 04:18:28 [DEBUG   ] summary = ERROR
2018-10-22 04:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231029  13 58413 15508785 A  ERRORERROR'
2018-10-22 04:18:28 [DEBUG   ] Got command RPT from MCS: ref #231030
2018-10-22 04:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231030  77 58413 15508786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:18:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 04:18:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 04:18:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:18:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 04:18:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:18:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:18:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:18:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:18:58 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-10-22 04:19:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:19:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 04:19:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:19:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:19:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:19:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:19:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:19:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:19:58 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-22 04:20:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:20:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 04:20:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 04:20:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:20:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:20:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:20:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:20:58 [WARNING ] (13, 1, 'bot')
2018-10-22 04:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:20:58 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-10-22 04:21:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 04:21:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 04:21:49 [DEBUG   ] Got command RPT from MCS: ref #231052
2018-10-22 04:21:49 [DEBUG   ] summary = ERROR
2018-10-22 04:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231052  13 58413 15709333 A  ERRORERROR'
2018-10-22 04:21:49 [DEBUG   ] Got command RPT from MCS: ref #231053
2018-10-22 04:21:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231053  77 58413 15709537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:21:49 [DEBUG   ] Got command RPT from MCS: ref #231054
2018-10-22 04:21:49 [DEBUG   ] summary = ERROR
2018-10-22 04:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231054  13 58413 15709729 A  ERRORERROR'
2018-10-22 04:21:49 [DEBUG   ] Got command RPT from MCS: ref #231056
2018-10-22 04:21:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231056  77 58413 15709933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:21:50 [DEBUG   ] Got command RPT from MCS: ref #231057
2018-10-22 04:21:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231057  12 58413 15710137 A  ERRORB›™š'
2018-10-22 04:21:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 04:21:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 04:21:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:21:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:21:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:21:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:21:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:21:59 [DEBUG   ] Finished updating board flags in 2.250 seconds
2018-10-22 04:22:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 04:22:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 04:22:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 04:22:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:22:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:22:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:22:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:22:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:22:59 [DEBUG   ] Finished updating board flags in 2.116 seconds
2018-10-22 04:23:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 04:23:28 [DEBUG   ] Got command RPT from MCS: ref #231062
2018-10-22 04:23:28 [DEBUG   ] summary = ERROR
2018-10-22 04:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231062  13 58413 15808785 A  ERRORERROR'
2018-10-22 04:23:28 [DEBUG   ] Got command RPT from MCS: ref #231063
2018-10-22 04:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231063  77 58413 15808786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:23:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 04:23:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 04:23:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 04:23:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:23:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:23:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:23:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:23:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:23:59 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-22 04:24:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 04:24:32 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-22 04:24:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 04:24:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 04:24:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:24:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:24:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:24:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:24:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:24:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:24:59 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-22 04:25:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:25:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:25:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 04:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 04:25:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:25:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:25:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:25:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:25:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:25:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:25:59 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-22 04:26:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:26:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:26:49 [DEBUG   ] Got command RPT from MCS: ref #231083
2018-10-22 04:26:49 [DEBUG   ] summary = ERROR
2018-10-22 04:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231083  13 58413 16009409 A  ERRORERROR'
2018-10-22 04:26:49 [DEBUG   ] Got command RPT from MCS: ref #231084
2018-10-22 04:26:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231084  77 58413 16009613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:26:49 [DEBUG   ] Got command RPT from MCS: ref #231085
2018-10-22 04:26:49 [DEBUG   ] summary = ERROR
2018-10-22 04:26:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231085  13 58413 16009817 A  ERRORERROR'
2018-10-22 04:26:50 [DEBUG   ] Got command RPT from MCS: ref #231086
2018-10-22 04:26:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231086  77 58413 16010021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:26:50 [DEBUG   ] Got command RPT from MCS: ref #231087
2018-10-22 04:26:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231087  12 58413 16010213 A  ERRORB›™š'
2018-10-22 04:26:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 04:26:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 04:26:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:26:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:26:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:26:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:26:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:26:59 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-22 04:27:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 04:27:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 04:27:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 04:27:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:27:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:27:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:27:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:27:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:27:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:27:59 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-22 04:28:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 04:28:28 [DEBUG   ] Got command RPT from MCS: ref #231092
2018-10-22 04:28:28 [DEBUG   ] summary = ERROR
2018-10-22 04:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231092  13 58413 16108793 A  ERRORERROR'
2018-10-22 04:28:28 [DEBUG   ] Got command RPT from MCS: ref #231093
2018-10-22 04:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231093  77 58413 16108794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:28:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 04:28:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 04:28:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:28:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:28:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:28:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:28:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:28:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:28:59 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-22 04:29:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 04:29:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 04:29:52 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 04:29:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:29:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:29:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:29:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:29:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:29:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:29:59 [DEBUG   ] Finished updating board flags in 1.665 seconds
2018-10-22 04:30:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 04:30:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 04:30:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 04:30:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:30:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 04:30:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:30:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:30:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:30:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:30:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:30:59 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-22 04:31:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 04:31:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 04:31:49 [DEBUG   ] Got command RPT from MCS: ref #231115
2018-10-22 04:31:49 [DEBUG   ] summary = ERROR
2018-10-22 04:31:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231115  13 58413 16309489 A  ERRORERROR'
2018-10-22 04:31:49 [DEBUG   ] Got command RPT from MCS: ref #231116
2018-10-22 04:31:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:31:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231116  77 58413 16309693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:31:49 [DEBUG   ] Got command RPT from MCS: ref #231117
2018-10-22 04:31:49 [DEBUG   ] summary = ERROR
2018-10-22 04:31:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231117  13 58413 16309897 A  ERRORERROR'
2018-10-22 04:31:50 [DEBUG   ] Got command RPT from MCS: ref #231119
2018-10-22 04:31:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231119  77 58413 16310101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:31:50 [DEBUG   ] Got command RPT from MCS: ref #231120
2018-10-22 04:31:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231120  12 58413 16310293 A  ERRORB›™š'
2018-10-22 04:31:53 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-22 04:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:31:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 04:31:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:31:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:31:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:31:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:31:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:31:59 [DEBUG   ] Finished updating board flags in 1.532 seconds
2018-10-22 04:32:13 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-22 04:32:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 04:32:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 04:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:32:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:32:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:32:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:32:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:32:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:32:59 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-10-22 04:33:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:33:28 [DEBUG   ] Got command RPT from MCS: ref #231129
2018-10-22 04:33:28 [DEBUG   ] summary = ERROR
2018-10-22 04:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231129  13 58413 16408793 A  ERRORERROR'
2018-10-22 04:33:28 [DEBUG   ] Got command RPT from MCS: ref #231130
2018-10-22 04:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231130  77 58413 16408794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:33:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 04:33:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:33:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:33:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:33:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:33:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:33:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:33:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:33:59 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-10-22 04:34:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:34:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 04:34:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 04:34:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:34:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:34:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:34:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:34:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:34:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:34:59 [DEBUG   ] Finished updating board flags in 1.454 seconds
2018-10-22 04:35:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 04:35:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 04:35:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 04:35:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 04:35:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:35:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:35:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:35:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:35:59 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-10-22 04:36:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 04:36:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 04:36:49 [DEBUG   ] Got command RPT from MCS: ref #231150
2018-10-22 04:36:49 [DEBUG   ] summary = ERROR
2018-10-22 04:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231150  13 58413 16609577 A  ERRORERROR'
2018-10-22 04:36:49 [DEBUG   ] Got command RPT from MCS: ref #231151
2018-10-22 04:36:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231151  77 58413 16609769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:36:49 [DEBUG   ] Got command RPT from MCS: ref #231152
2018-10-22 04:36:49 [DEBUG   ] summary = ERROR
2018-10-22 04:36:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231152  13 58413 16609973 A  ERRORERROR'
2018-10-22 04:36:50 [DEBUG   ] Got command RPT from MCS: ref #231153
2018-10-22 04:36:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:36:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231153  77 58413 16610177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:36:50 [DEBUG   ] Got command RPT from MCS: ref #231154
2018-10-22 04:36:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:36:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231154  12 58413 16610381 A  ERRORBœ™š'
2018-10-22 04:36:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 04:36:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:36:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:36:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:36:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:36:59 [WARNING ] (13, 1, 'bot')
2018-10-22 04:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:36:59 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-10-22 04:37:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 04:37:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 04:37:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 04:37:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:38:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:38:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:38:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:38:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:38:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:38:00 [DEBUG   ] Finished updating board flags in 2.164 seconds
2018-10-22 04:38:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 04:38:28 [DEBUG   ] Got command RPT from MCS: ref #231155
2018-10-22 04:38:28 [DEBUG   ] summary = ERROR
2018-10-22 04:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231155  13 58413 16708789 A  ERRORERROR'
2018-10-22 04:38:28 [DEBUG   ] Got command RPT from MCS: ref #231156
2018-10-22 04:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231156  77 58413 16708790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:38:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 04:38:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 04:38:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:39:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 04:39:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:39:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:39:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:39:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:39:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:39:00 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-10-22 04:39:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 04:39:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 04:39:53 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-22 04:39:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:40:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:40:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:40:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:40:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:40:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:40:00 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-10-22 04:40:14 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-10-22 04:40:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-22 04:40:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:40:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 04:41:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:41:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:41:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:41:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:41:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:41:00 [DEBUG   ] Finished updating board flags in 1.743 seconds
2018-10-22 04:41:14 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-10-22 04:41:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 04:41:49 [DEBUG   ] Got command RPT from MCS: ref #231178
2018-10-22 04:41:49 [DEBUG   ] summary = ERROR
2018-10-22 04:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231178  13 58413 16909653 A  ERRORERROR'
2018-10-22 04:41:49 [DEBUG   ] Got command RPT from MCS: ref #231179
2018-10-22 04:41:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:41:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231179  77 58413 16909857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:41:50 [DEBUG   ] Got command RPT from MCS: ref #231180
2018-10-22 04:41:50 [DEBUG   ] summary = ERROR
2018-10-22 04:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231180  13 58413 16910049 A  ERRORERROR'
2018-10-22 04:41:50 [DEBUG   ] Got command RPT from MCS: ref #231182
2018-10-22 04:41:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231182  77 58413 16910253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:41:50 [DEBUG   ] Got command RPT from MCS: ref #231183
2018-10-22 04:41:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231183  12 58413 16910457 A  ERRORBœ™š'
2018-10-22 04:41:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 04:41:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:42:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 04:42:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:42:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:42:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:42:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:42:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:42:00 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-22 04:42:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 04:42:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 04:42:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 04:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:43:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:43:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:43:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:43:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:43:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:43:00 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-22 04:43:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 04:43:28 [DEBUG   ] Got command RPT from MCS: ref #231192
2018-10-22 04:43:28 [DEBUG   ] summary = ERROR
2018-10-22 04:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231192  13 58413 17008797 A  ERRORERROR'
2018-10-22 04:43:28 [DEBUG   ] Got command RPT from MCS: ref #231193
2018-10-22 04:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231193  77 58413 17008798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:43:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 04:43:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 04:43:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 04:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:44:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:44:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:44:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:44:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:44:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:44:00 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-10-22 04:44:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 04:44:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 04:44:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 04:44:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:45:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:45:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:45:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:45:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:45:00 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-10-22 04:45:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 04:45:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 04:45:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 04:45:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:46:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:46:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:46:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:46:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:46:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:46:00 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-22 04:46:15 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-22 04:46:35 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-22 04:46:49 [DEBUG   ] Got command RPT from MCS: ref #231213
2018-10-22 04:46:49 [DEBUG   ] summary = ERROR
2018-10-22 04:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231213  13 58413 17209733 A  ERRORERROR'
2018-10-22 04:46:49 [DEBUG   ] Got command RPT from MCS: ref #231214
2018-10-22 04:46:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:46:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231214  77 58413 17209937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:46:50 [DEBUG   ] Got command RPT from MCS: ref #231215
2018-10-22 04:46:50 [DEBUG   ] summary = ERROR
2018-10-22 04:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231215  13 58413 17210141 A  ERRORERROR'
2018-10-22 04:46:50 [DEBUG   ] Got command RPT from MCS: ref #231216
2018-10-22 04:46:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231216  77 58413 17210333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:46:50 [DEBUG   ] Got command RPT from MCS: ref #231217
2018-10-22 04:46:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231217  12 58413 17210537 A  ERRORB›™š'
2018-10-22 04:46:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:46:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 04:47:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:47:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:47:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:47:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:47:00 [WARNING ] (13, 1, 'bot')
2018-10-22 04:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:47:00 [DEBUG   ] Finished updating board flags in 1.365 seconds
2018-10-22 04:47:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 04:47:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 04:47:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 04:48:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:48:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:48:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:48:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:48:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:48:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:48:01 [DEBUG   ] Finished updating board flags in 2.060 seconds
2018-10-22 04:48:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 04:48:28 [DEBUG   ] Got command RPT from MCS: ref #231222
2018-10-22 04:48:28 [DEBUG   ] summary = ERROR
2018-10-22 04:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231222  13 58413 17308797 A  ERRORERROR'
2018-10-22 04:48:28 [DEBUG   ] Got command RPT from MCS: ref #231223
2018-10-22 04:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231223  77 58413 17308798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:48:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 04:48:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 04:49:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:49:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:49:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:49:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:49:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:49:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:49:01 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-10-22 04:49:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 04:49:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 04:49:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 04:50:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:50:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:50:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:50:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:50:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:50:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:50:01 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-22 04:50:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 04:50:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 04:50:56 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2018-10-22 04:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:51:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:51:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:51:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:51:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:51:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:51:01 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-22 04:51:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 04:51:36 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2018-10-22 04:51:49 [DEBUG   ] Got command RPT from MCS: ref #231245
2018-10-22 04:51:49 [DEBUG   ] summary = ERROR
2018-10-22 04:51:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231245  13 58413 17509817 A  ERRORERROR'
2018-10-22 04:51:50 [DEBUG   ] Got command RPT from MCS: ref #231246
2018-10-22 04:51:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231246  77 58413 17510021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:51:50 [DEBUG   ] Got command RPT from MCS: ref #231247
2018-10-22 04:51:50 [DEBUG   ] summary = ERROR
2018-10-22 04:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231247  13 58413 17510213 A  ERRORERROR'
2018-10-22 04:51:50 [DEBUG   ] Got command RPT from MCS: ref #231249
2018-10-22 04:51:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231249  77 58413 17510417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:51:50 [DEBUG   ] Got command RPT from MCS: ref #231251
2018-10-22 04:51:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231251  12 58413 17510621 A  ERRORBš™š'
2018-10-22 04:51:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 04:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:52:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 04:52:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:52:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:52:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:52:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:52:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:52:01 [DEBUG   ] Finished updating board flags in 1.660 seconds
2018-10-22 04:52:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 04:52:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 04:52:56 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-22 04:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:53:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:53:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:53:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:53:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:53:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:53:01 [DEBUG   ] Finished updating board flags in 1.560 seconds
2018-10-22 04:53:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 04:53:28 [DEBUG   ] Got command RPT from MCS: ref #231255
2018-10-22 04:53:28 [DEBUG   ] summary = ERROR
2018-10-22 04:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231255  13 58413 17608797 A  ERRORERROR'
2018-10-22 04:53:28 [DEBUG   ] Got command RPT from MCS: ref #231256
2018-10-22 04:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231256  77 58413 17608798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:53:36 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-10-22 04:53:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-22 04:54:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:54:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:54:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:54:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:54:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:54:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:54:01 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-22 04:54:16 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-22 04:54:35 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-22 04:54:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:55:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:55:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:55:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:55:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:55:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:55:01 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-10-22 04:55:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 04:55:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 04:55:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 04:56:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:56:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:56:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:56:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:56:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:56:01 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-22 04:56:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 04:56:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 04:56:49 [DEBUG   ] Got command RPT from MCS: ref #231276
2018-10-22 04:56:49 [DEBUG   ] summary = ERROR
2018-10-22 04:56:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231276  13 58413 17809893 A  ERRORERROR'
2018-10-22 04:56:50 [DEBUG   ] Got command RPT from MCS: ref #231277
2018-10-22 04:56:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231277  77 58413 17810097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:56:50 [DEBUG   ] Got command RPT from MCS: ref #231278
2018-10-22 04:56:50 [DEBUG   ] summary = ERROR
2018-10-22 04:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231278  13 58413 17810301 A  ERRORERROR'
2018-10-22 04:56:50 [DEBUG   ] Got command RPT from MCS: ref #231279
2018-10-22 04:56:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231279  77 58413 17810505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:56:50 [DEBUG   ] Got command RPT from MCS: ref #231280
2018-10-22 04:56:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 04:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231280  12 58413 17810697 A  ERRORB˜™š'
2018-10-22 04:56:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 04:57:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:57:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:57:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:57:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:57:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:57:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:57:01 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-22 04:57:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 04:57:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 04:57:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 04:58:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 04:58:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:58:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 04:58:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:58:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:58:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:58:01 [WARNING ] (13, 1, 'bot')
2018-10-22 04:58:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:58:01 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-10-22 04:58:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 04:58:28 [DEBUG   ] Got command RPT from MCS: ref #231285
2018-10-22 04:58:28 [DEBUG   ] summary = ERROR
2018-10-22 04:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231285  13 58413 17908797 A  ERRORERROR'
2018-10-22 04:58:28 [DEBUG   ] Got command RPT from MCS: ref #231286
2018-10-22 04:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 04:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231286  77 58413 17908798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 04:58:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 04:58:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 04:59:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 04:59:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 04:59:02 [WARNING ] (13, 1, 'bot')
2018-10-22 04:59:02 [WARNING ] (13, 1, 'bot')
2018-10-22 04:59:02 [WARNING ] (13, 1, 'bot')
2018-10-22 04:59:02 [WARNING ] (13, 1, 'bot')
2018-10-22 04:59:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 04:59:02 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-10-22 04:59:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 04:59:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 04:59:56 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 05:00:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:00:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:00:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:00:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:00:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:00:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:00:02 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-10-22 05:00:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 05:00:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 05:00:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-22 05:01:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:01:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 05:01:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:01:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:01:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:01:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:01:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:01:02 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-10-22 05:01:17 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-22 05:01:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 05:01:49 [DEBUG   ] Got command RPT from MCS: ref #231308
2018-10-22 05:01:49 [DEBUG   ] summary = ERROR
2018-10-22 05:01:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231308  13 58413 18109973 A  ERRORERROR'
2018-10-22 05:01:50 [DEBUG   ] Got command RPT from MCS: ref #231309
2018-10-22 05:01:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231309  77 58413 18110177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:01:50 [DEBUG   ] Got command RPT from MCS: ref #231310
2018-10-22 05:01:50 [DEBUG   ] summary = ERROR
2018-10-22 05:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231310  13 58413 18110381 A  ERRORERROR'
2018-10-22 05:01:50 [DEBUG   ] Got command RPT from MCS: ref #231312
2018-10-22 05:01:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231312  77 58413 18110573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:01:50 [DEBUG   ] Got command RPT from MCS: ref #231313
2018-10-22 05:01:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231313  12 58413 18110777 A  ERRORB—™š'
2018-10-22 05:01:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 05:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 05:02:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:02:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:02:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:02:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:02:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:02:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:02:02 [DEBUG   ] Finished updating board flags in 2.314 seconds
2018-10-22 05:02:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 05:02:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 05:02:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 05:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 05:03:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:03:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:03:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:03:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:03:02 [DEBUG   ] Finished updating board flags in 2.076 seconds
2018-10-22 05:03:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 05:03:28 [DEBUG   ] Got command RPT from MCS: ref #231322
2018-10-22 05:03:28 [DEBUG   ] summary = ERROR
2018-10-22 05:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231322  13 58413 18208801 A  ERRORERROR'
2018-10-22 05:03:28 [DEBUG   ] Got command RPT from MCS: ref #231323
2018-10-22 05:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231323  77 58413 18208802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:03:37 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-22 05:03:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 05:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:04:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:04:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:04:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:04:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:04:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:04:02 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-10-22 05:04:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 05:04:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 05:04:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 05:05:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:05:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:05:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:05:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:05:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:05:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:05:02 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-22 05:05:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 05:05:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 05:05:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 05:06:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:06:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:06:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:06:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:06:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:06:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:06:02 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-22 05:06:18 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-22 05:06:38 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-22 05:06:50 [DEBUG   ] Got command RPT from MCS: ref #231343
2018-10-22 05:06:50 [DEBUG   ] summary = ERROR
2018-10-22 05:06:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231343  13 58413 18410057 A  ERRORERROR'
2018-10-22 05:06:50 [DEBUG   ] Got command RPT from MCS: ref #231344
2018-10-22 05:06:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:06:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231344  77 58413 18410261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:06:50 [DEBUG   ] Got command RPT from MCS: ref #231345
2018-10-22 05:06:50 [DEBUG   ] summary = ERROR
2018-10-22 05:06:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231345  13 58413 18410453 A  ERRORERROR'
2018-10-22 05:06:50 [DEBUG   ] Got command RPT from MCS: ref #231346
2018-10-22 05:06:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:06:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231346  77 58413 18410657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:06:50 [DEBUG   ] Got command RPT from MCS: ref #231347
2018-10-22 05:06:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:06:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231347  12 58413 18410861 A  ERRORB—™š'
2018-10-22 05:06:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 05:07:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:07:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:07:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:07:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:07:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:07:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:07:02 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-22 05:07:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 05:07:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 05:07:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 05:08:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:08:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:08:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:08:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:08:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:08:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:08:02 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-22 05:08:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 05:08:28 [DEBUG   ] Got command RPT from MCS: ref #231348
2018-10-22 05:08:28 [DEBUG   ] summary = ERROR
2018-10-22 05:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231348  13 58413 18508793 A  ERRORERROR'
2018-10-22 05:08:28 [DEBUG   ] Got command RPT from MCS: ref #231349
2018-10-22 05:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231349  77 58413 18508794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:08:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 05:08:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 05:09:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:09:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:09:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:09:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:09:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:09:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:09:02 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-22 05:09:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 05:09:38 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-22 05:09:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 05:10:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:10:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:10:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:10:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:10:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:10:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:10:02 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-10-22 05:10:18 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-10-22 05:10:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 05:10:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 05:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:11:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:11:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:11:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:11:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:11:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:11:02 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-22 05:11:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 05:11:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 05:11:50 [DEBUG   ] Got command RPT from MCS: ref #231371
2018-10-22 05:11:50 [DEBUG   ] summary = ERROR
2018-10-22 05:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231371  13 58413 18710137 A  ERRORERROR'
2018-10-22 05:11:50 [DEBUG   ] Got command RPT from MCS: ref #231372
2018-10-22 05:11:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231372  77 58413 18710341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:11:50 [DEBUG   ] Got command RPT from MCS: ref #231373
2018-10-22 05:11:50 [DEBUG   ] summary = ERROR
2018-10-22 05:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231373  13 58413 18710533 A  ERRORERROR'
2018-10-22 05:11:50 [DEBUG   ] Got command RPT from MCS: ref #231375
2018-10-22 05:11:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231375  77 58413 18710737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:11:50 [DEBUG   ] Got command RPT from MCS: ref #231377
2018-10-22 05:11:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231377  12 58413 18710941 A  ERRORB—™š'
2018-10-22 05:11:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 05:12:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:12:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:12:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:12:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:12:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:12:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:12:02 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-22 05:12:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-22 05:12:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 05:12:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 05:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 05:13:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:13:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:13:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:13:02 [WARNING ] (13, 1, 'bot')
2018-10-22 05:13:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:13:02 [DEBUG   ] Finished updating board flags in 1.349 seconds
2018-10-22 05:13:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 05:13:28 [DEBUG   ] Got command RPT from MCS: ref #231385
2018-10-22 05:13:28 [DEBUG   ] summary = ERROR
2018-10-22 05:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231385  13 58413 18808802 A  ERRORERROR'
2018-10-22 05:13:28 [DEBUG   ] Got command RPT from MCS: ref #231386
2018-10-22 05:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231386  77 58413 18808802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:13:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 05:13:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 05:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 05:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:14:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 05:14:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:14:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:14:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:14:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:14:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:14:03 [DEBUG   ] Finished updating board flags in 2.067 seconds
2018-10-22 05:14:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 05:14:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 05:14:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 05:15:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 05:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:15:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:15:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:15:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:15:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:15:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:15:03 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-22 05:15:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 05:15:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 05:15:59 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-22 05:16:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:16:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:16:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:16:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:16:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:16:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:16:03 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-22 05:16:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 05:16:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 05:16:50 [DEBUG   ] Got command RPT from MCS: ref #231406
2018-10-22 05:16:50 [DEBUG   ] summary = ERROR
2018-10-22 05:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231406  13 58413 19010209 A  ERRORERROR'
2018-10-22 05:16:50 [DEBUG   ] Got command RPT from MCS: ref #231407
2018-10-22 05:16:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231407  77 58413 19010413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:16:50 [DEBUG   ] Got command RPT from MCS: ref #231408
2018-10-22 05:16:50 [DEBUG   ] summary = ERROR
2018-10-22 05:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231408  13 58413 19010617 A  ERRORERROR'
2018-10-22 05:16:50 [DEBUG   ] Got command RPT from MCS: ref #231409
2018-10-22 05:16:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:16:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231409  77 58413 19010821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:16:51 [DEBUG   ] Got command RPT from MCS: ref #231410
2018-10-22 05:16:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231410  12 58413 19011014 A  ERRORB˜™š'
2018-10-22 05:16:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 05:17:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:17:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:17:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:17:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:17:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:17:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:17:03 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-22 05:17:19 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 05:17:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 05:17:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 05:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-22 05:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 05:18:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:18:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:18:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:18:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:18:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:18:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:18:03 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-22 05:18:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-22 05:18:28 [DEBUG   ] Got command RPT from MCS: ref #231415
2018-10-22 05:18:28 [DEBUG   ] summary = ERROR
2018-10-22 05:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231415  13 58413 19108805 A  ERRORERROR'
2018-10-22 05:18:28 [DEBUG   ] Got command RPT from MCS: ref #231416
2018-10-22 05:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231416  77 58413 19108806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:18:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-22 05:19:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 05:19:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 05:19:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:19:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:19:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:19:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:19:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:19:03 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-22 05:19:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 05:19:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 05:20:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 05:20:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:20:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:20:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:20:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:20:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:20:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:20:03 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-10-22 05:20:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 05:20:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 05:21:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 05:21:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 05:21:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:21:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:21:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:21:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:21:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:21:03 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-10-22 05:21:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 05:21:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 05:21:50 [DEBUG   ] Got command RPT from MCS: ref #231438
2018-10-22 05:21:50 [DEBUG   ] summary = ERROR
2018-10-22 05:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231438  13 58413 19310297 A  ERRORERROR'
2018-10-22 05:21:50 [DEBUG   ] Got command RPT from MCS: ref #231439
2018-10-22 05:21:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231439  77 58413 19310489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:21:50 [DEBUG   ] Got command RPT from MCS: ref #231440
2018-10-22 05:21:50 [DEBUG   ] summary = ERROR
2018-10-22 05:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231440  13 58413 19310693 A  ERRORERROR'
2018-10-22 05:21:50 [DEBUG   ] Got command RPT from MCS: ref #231442
2018-10-22 05:21:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231442  77 58413 19310897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:21:51 [DEBUG   ] Got command RPT from MCS: ref #231443
2018-10-22 05:21:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231443  12 58413 19311101 A  ERRORB˜™š'
2018-10-22 05:22:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 05:22:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:22:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:22:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:22:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:22:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:22:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:22:03 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-22 05:22:20 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-22 05:22:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 05:23:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 05:23:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:23:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:23:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:23:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:23:03 [WARNING ] (13, 1, 'bot')
2018-10-22 05:23:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:23:03 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-10-22 05:23:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 05:23:28 [DEBUG   ] Got command RPT from MCS: ref #231448
2018-10-22 05:23:28 [DEBUG   ] summary = ERROR
2018-10-22 05:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231448  13 58413 19408805 A  ERRORERROR'
2018-10-22 05:23:28 [DEBUG   ] Got command RPT from MCS: ref #231449
2018-10-22 05:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231449  77 58413 19408806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:23:41 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2018-10-22 05:24:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 05:24:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 05:24:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:24:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:24:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:24:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:24:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:24:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:24:04 [DEBUG   ] Finished updating board flags in 2.217 seconds
2018-10-22 05:24:21 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-22 05:24:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 05:25:01 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-22 05:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 05:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:25:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:25:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:25:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:25:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:25:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:25:04 [DEBUG   ] Finished updating board flags in 2.171 seconds
2018-10-22 05:25:20 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-22 05:25:41 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 05:26:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 05:26:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:26:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:26:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:26:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:26:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:26:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:26:04 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-22 05:26:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 05:26:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 05:26:50 [DEBUG   ] Got command RPT from MCS: ref #231469
2018-10-22 05:26:50 [DEBUG   ] summary = ERROR
2018-10-22 05:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231469  13 58413 19610377 A  ERRORERROR'
2018-10-22 05:26:50 [DEBUG   ] Got command RPT from MCS: ref #231470
2018-10-22 05:26:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231470  77 58413 19610569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:26:50 [DEBUG   ] Got command RPT from MCS: ref #231471
2018-10-22 05:26:50 [DEBUG   ] summary = ERROR
2018-10-22 05:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231471  13 58413 19610773 A  ERRORERROR'
2018-10-22 05:26:50 [DEBUG   ] Got command RPT from MCS: ref #231472
2018-10-22 05:26:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:26:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231472  77 58413 19610977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:26:51 [DEBUG   ] Got command RPT from MCS: ref #231473
2018-10-22 05:26:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:26:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231473  12 58413 19611181 A  ERRORB˜™š'
2018-10-22 05:27:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 05:27:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:27:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:27:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:27:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:27:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:27:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:27:04 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-22 05:27:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 05:27:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 05:28:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 05:28:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:28:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:28:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:28:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:28:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:28:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:28:04 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-22 05:28:21 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 05:28:28 [DEBUG   ] Got command RPT from MCS: ref #231478
2018-10-22 05:28:28 [DEBUG   ] summary = ERROR
2018-10-22 05:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231478  13 58413 19708801 A  ERRORERROR'
2018-10-22 05:28:28 [DEBUG   ] Got command RPT from MCS: ref #231479
2018-10-22 05:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231479  77 58413 19708802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:28:41 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-22 05:29:02 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-22 05:29:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:29:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:29:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:29:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:29:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:29:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:29:04 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-22 05:29:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-22 05:29:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 05:30:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 05:30:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:30:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:30:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:30:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:30:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:30:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:30:04 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-10-22 05:30:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 05:30:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 05:31:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 05:31:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:31:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:31:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:31:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:31:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:31:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:31:04 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-10-22 05:31:22 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-22 05:31:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 05:31:50 [DEBUG   ] Got command RPT from MCS: ref #231501
2018-10-22 05:31:50 [DEBUG   ] summary = ERROR
2018-10-22 05:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231501  13 58413 19910449 A  ERRORERROR'
2018-10-22 05:31:50 [DEBUG   ] Got command RPT from MCS: ref #231502
2018-10-22 05:31:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231502  77 58413 19910653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:31:50 [DEBUG   ] Got command RPT from MCS: ref #231503
2018-10-22 05:31:50 [DEBUG   ] summary = ERROR
2018-10-22 05:31:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231503  13 58413 19910857 A  ERRORERROR'
2018-10-22 05:31:51 [DEBUG   ] Got command RPT from MCS: ref #231505
2018-10-22 05:31:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231505  77 58413 19911049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:31:51 [DEBUG   ] Got command RPT from MCS: ref #231506
2018-10-22 05:31:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231506  12 58413 19911253 A  ERRORB˜™š'
2018-10-22 05:32:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-22 05:32:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:32:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:32:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:32:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:32:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:32:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:32:04 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-22 05:32:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 05:32:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 05:33:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 05:33:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:33:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:33:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:33:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:33:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:33:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:33:04 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-10-22 05:33:22 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 05:33:28 [DEBUG   ] Got command RPT from MCS: ref #231515
2018-10-22 05:33:28 [DEBUG   ] summary = ERROR
2018-10-22 05:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231515  13 58413 20008801 A  ERRORERROR'
2018-10-22 05:33:28 [DEBUG   ] Got command RPT from MCS: ref #231516
2018-10-22 05:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231516  77 58413 20008802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:33:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 05:34:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 05:34:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:34:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:34:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:34:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:34:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:34:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:34:04 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-10-22 05:34:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 05:34:42 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-22 05:35:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 05:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:35:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:35:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:35:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:35:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:35:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:35:04 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-10-22 05:35:22 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-22 05:35:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 05:36:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 05:36:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 05:36:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:36:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:36:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:36:04 [WARNING ] (13, 1, 'bot')
2018-10-22 05:36:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:36:04 [DEBUG   ] Finished updating board flags in 1.475 seconds
2018-10-22 05:36:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 05:36:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 05:36:50 [DEBUG   ] Got command RPT from MCS: ref #231536
2018-10-22 05:36:50 [DEBUG   ] summary = ERROR
2018-10-22 05:36:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231536  13 58413 20210529 A  ERRORERROR'
2018-10-22 05:36:50 [DEBUG   ] Got command RPT from MCS: ref #231537
2018-10-22 05:36:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:36:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231537  77 58413 20210733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:36:50 [DEBUG   ] Got command RPT from MCS: ref #231538
2018-10-22 05:36:50 [DEBUG   ] summary = ERROR
2018-10-22 05:36:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231538  13 58413 20210937 A  ERRORERROR'
2018-10-22 05:36:51 [DEBUG   ] Got command RPT from MCS: ref #231539
2018-10-22 05:36:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231539  77 58413 20211129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:36:51 [DEBUG   ] Got command RPT from MCS: ref #231540
2018-10-22 05:36:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231540  12 58413 20211333 A  ERRORB—™š'
2018-10-22 05:37:03 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-22 05:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 05:37:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:37:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:37:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:37:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:37:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:37:05 [DEBUG   ] Finished updating board flags in 2.249 seconds
2018-10-22 05:37:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 05:37:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 05:38:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 05:38:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:38:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:38:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:38:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:38:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:38:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:38:05 [DEBUG   ] Finished updating board flags in 2.113 seconds
2018-10-22 05:38:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 05:38:28 [DEBUG   ] Got command RPT from MCS: ref #231541
2018-10-22 05:38:28 [DEBUG   ] summary = ERROR
2018-10-22 05:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231541  13 58413 20308809 A  ERRORERROR'
2018-10-22 05:38:28 [DEBUG   ] Got command RPT from MCS: ref #231542
2018-10-22 05:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231542  77 58413 20308810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:38:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 05:39:03 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-22 05:39:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:39:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:39:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:39:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:39:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:39:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:39:05 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-10-22 05:39:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 05:39:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 05:40:04 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2018-10-22 05:40:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:40:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:40:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:40:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:40:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:40:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:40:05 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-10-22 05:40:24 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-10-22 05:40:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 05:41:04 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-10-22 05:41:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:41:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:41:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:41:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:41:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:41:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:41:05 [DEBUG   ] Finished updating board flags in 1.634 seconds
2018-10-22 05:41:24 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-10-22 05:41:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 05:41:50 [DEBUG   ] Got command RPT from MCS: ref #231564
2018-10-22 05:41:50 [DEBUG   ] summary = ERROR
2018-10-22 05:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231564  13 58413 20510609 A  ERRORERROR'
2018-10-22 05:41:50 [DEBUG   ] Got command RPT from MCS: ref #231565
2018-10-22 05:41:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:41:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231565  77 58413 20510813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:41:51 [DEBUG   ] Got command RPT from MCS: ref #231566
2018-10-22 05:41:51 [DEBUG   ] summary = ERROR
2018-10-22 05:41:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231566  13 58413 20511005 A  ERRORERROR'
2018-10-22 05:41:51 [DEBUG   ] Got command RPT from MCS: ref #231568
2018-10-22 05:41:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:41:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231568  77 58413 20511209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:41:51 [DEBUG   ] Got command RPT from MCS: ref #231569
2018-10-22 05:41:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:41:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231569  12 58413 20511413 A  ERRORB—™š'
2018-10-22 05:42:04 [DEBUG   ] Finished updating ant stats in 0.851 seconds
2018-10-22 05:42:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:42:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 05:42:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:42:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:42:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:42:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:42:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:42:05 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-22 05:42:24 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-10-22 05:42:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 05:43:04 [DEBUG   ] Finished updating ant stats in 0.452 seconds
2018-10-22 05:43:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:43:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:43:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:43:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:43:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:43:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:43:05 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-10-22 05:43:25 [DEBUG   ] Finished updating ant stats in 1.352 seconds
2018-10-22 05:43:28 [DEBUG   ] Got command RPT from MCS: ref #231578
2018-10-22 05:43:28 [DEBUG   ] summary = ERROR
2018-10-22 05:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231578  13 58413 20608805 A  ERRORERROR'
2018-10-22 05:43:28 [DEBUG   ] Got command RPT from MCS: ref #231579
2018-10-22 05:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231579  77 58413 20608806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:43:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 05:44:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 05:44:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:44:05 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2018-10-22 05:44:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:44:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:44:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:44:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:44:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:44:05 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-10-22 05:44:25 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-10-22 05:44:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 05:45:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:45:05 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2018-10-22 05:45:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:45:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:45:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:45:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:45:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:45:05 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-10-22 05:45:25 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-10-22 05:45:45 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 05:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 05:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:46:05 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2018-10-22 05:46:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:46:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:46:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:46:05 [WARNING ] (13, 1, 'bot')
2018-10-22 05:46:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:46:05 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-10-22 05:46:25 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2018-10-22 05:46:46 [DEBUG   ] Finished updating ant stats in 1.406 seconds
2018-10-22 05:46:50 [DEBUG   ] Got command RPT from MCS: ref #231599
2018-10-22 05:46:50 [DEBUG   ] summary = ERROR
2018-10-22 05:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231599  13 58413 20810685 A  ERRORERROR'
2018-10-22 05:46:50 [DEBUG   ] Got command RPT from MCS: ref #231600
2018-10-22 05:46:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:46:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231600  77 58413 20810889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:46:51 [DEBUG   ] Got command RPT from MCS: ref #231601
2018-10-22 05:46:51 [DEBUG   ] summary = ERROR
2018-10-22 05:46:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231601  13 58413 20811093 A  ERRORERROR'
2018-10-22 05:46:51 [DEBUG   ] Got command RPT from MCS: ref #231602
2018-10-22 05:46:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:46:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231602  77 58413 20811297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:46:51 [DEBUG   ] Got command RPT from MCS: ref #231603
2018-10-22 05:46:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:46:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231603  12 58413 20811489 A  ERRORB˜™š'
2018-10-22 05:47:05 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-10-22 05:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:47:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 05:47:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:47:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:47:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:47:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:47:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:47:06 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-10-22 05:47:26 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2018-10-22 05:47:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 05:48:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:48:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 05:48:06 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2018-10-22 05:48:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:48:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:48:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:48:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:48:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:48:06 [DEBUG   ] Finished updating board flags in 2.256 seconds
2018-10-22 05:48:26 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-10-22 05:48:28 [DEBUG   ] Got command RPT from MCS: ref #231608
2018-10-22 05:48:28 [DEBUG   ] summary = ERROR
2018-10-22 05:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231608  13 58413 20908809 A  ERRORERROR'
2018-10-22 05:48:28 [DEBUG   ] Got command RPT from MCS: ref #231609
2018-10-22 05:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231609  77 58413 20908810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:48:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 05:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 05:49:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:49:06 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2018-10-22 05:49:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:49:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:49:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:49:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:49:06 [DEBUG   ] Finished updating board flags in 2.190 seconds
2018-10-22 05:49:26 [DEBUG   ] Finished updating ant stats in 0.961 seconds
2018-10-22 05:49:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 05:50:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:50:06 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-10-22 05:50:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:50:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:50:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:50:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:50:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:50:06 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-10-22 05:50:26 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-10-22 05:50:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 05:51:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:51:06 [DEBUG   ] Finished updating ant stats in 0.444 seconds
2018-10-22 05:51:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:51:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:51:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:51:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:51:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:51:06 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-22 05:51:27 [DEBUG   ] Finished updating ant stats in 1.361 seconds
2018-10-22 05:51:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 05:51:50 [DEBUG   ] Got command RPT from MCS: ref #231631
2018-10-22 05:51:50 [DEBUG   ] summary = ERROR
2018-10-22 05:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231631  13 58413 21110769 A  ERRORERROR'
2018-10-22 05:51:50 [DEBUG   ] Got command RPT from MCS: ref #231632
2018-10-22 05:51:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:51:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231632  77 58413 21110973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:51:51 [DEBUG   ] Got command RPT from MCS: ref #231633
2018-10-22 05:51:51 [DEBUG   ] summary = ERROR
2018-10-22 05:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231633  13 58413 21111177 A  ERRORERROR'
2018-10-22 05:51:51 [DEBUG   ] Got command RPT from MCS: ref #231635
2018-10-22 05:51:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231635  77 58413 21111369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:51:51 [DEBUG   ] Got command RPT from MCS: ref #231636
2018-10-22 05:51:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231636  12 58413 21111573 A  ERRORB˜™š'
2018-10-22 05:52:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:52:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 05:52:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 05:52:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:52:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:52:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:52:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:52:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:52:06 [DEBUG   ] Finished updating board flags in 1.958 seconds
2018-10-22 05:52:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 05:52:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 05:52:47 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-22 05:53:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:53:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:53:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:53:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:53:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:53:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:53:06 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-10-22 05:53:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 05:53:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 05:53:28 [DEBUG   ] Got command RPT from MCS: ref #231641
2018-10-22 05:53:28 [DEBUG   ] summary = ERROR
2018-10-22 05:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231641  13 58413 21208805 A  ERRORERROR'
2018-10-22 05:53:28 [DEBUG   ] Got command RPT from MCS: ref #231642
2018-10-22 05:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231642  77 58413 21208806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:53:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 05:54:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 05:54:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:54:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:54:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:54:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:54:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:54:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:54:06 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-10-22 05:54:07 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-22 05:54:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 05:54:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 05:55:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:55:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:55:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:55:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:55:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:55:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:55:06 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-10-22 05:55:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 05:55:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 05:55:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 05:56:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:56:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:56:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:56:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:56:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:56:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:56:06 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-10-22 05:56:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 05:56:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-22 05:56:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-22 05:56:50 [DEBUG   ] Got command RPT from MCS: ref #231662
2018-10-22 05:56:50 [DEBUG   ] summary = ERROR
2018-10-22 05:56:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231662  13 58413 21410853 A  ERRORERROR'
2018-10-22 05:56:51 [DEBUG   ] Got command RPT from MCS: ref #231663
2018-10-22 05:56:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231663  77 58413 21411057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:56:51 [DEBUG   ] Got command RPT from MCS: ref #231664
2018-10-22 05:56:51 [DEBUG   ] summary = ERROR
2018-10-22 05:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231664  13 58413 21411249 A  ERRORERROR'
2018-10-22 05:56:51 [DEBUG   ] Got command RPT from MCS: ref #231665
2018-10-22 05:56:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231665  77 58413 21411453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:56:51 [DEBUG   ] Got command RPT from MCS: ref #231666
2018-10-22 05:56:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 05:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231666  12 58413 21411657 A  ERRORB˜™š'
2018-10-22 05:57:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:57:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:57:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:57:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:57:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:57:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:57:06 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-10-22 05:57:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 05:57:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 05:57:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 05:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 05:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 05:58:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:58:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:58:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:58:06 [WARNING ] (13, 1, 'bot')
2018-10-22 05:58:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:58:06 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-22 05:58:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 05:58:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 05:58:28 [DEBUG   ] Got command RPT from MCS: ref #231671
2018-10-22 05:58:28 [DEBUG   ] summary = ERROR
2018-10-22 05:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231671  13 58413 21508813 A  ERRORERROR'
2018-10-22 05:58:28 [DEBUG   ] Got command RPT from MCS: ref #231672
2018-10-22 05:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 05:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231672  77 58413 21508814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 05:58:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 05:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 05:59:07 [WARNING ] (13, 1, 'bot')
2018-10-22 05:59:07 [WARNING ] (13, 1, 'bot')
2018-10-22 05:59:07 [WARNING ] (13, 1, 'bot')
2018-10-22 05:59:07 [WARNING ] (13, 1, 'bot')
2018-10-22 05:59:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 05:59:07 [DEBUG   ] Finished updating board flags in 2.066 seconds
2018-10-22 05:59:08 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 05:59:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 05:59:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:00:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:00:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:00:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:00:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:00:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:00:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:00:07 [DEBUG   ] Finished updating board flags in 1.966 seconds
2018-10-22 06:00:08 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-10-22 06:00:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 06:00:49 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-22 06:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-22 06:01:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:01:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:01:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:01:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:01:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:01:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:01:07 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-10-22 06:01:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 06:01:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 06:01:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 06:01:50 [DEBUG   ] Got command RPT from MCS: ref #231694
2018-10-22 06:01:50 [DEBUG   ] summary = ERROR
2018-10-22 06:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231694  13 58413 21710937 A  ERRORERROR'
2018-10-22 06:01:51 [DEBUG   ] Got command RPT from MCS: ref #231695
2018-10-22 06:01:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231695  77 58413 21711129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:01:51 [DEBUG   ] Got command RPT from MCS: ref #231696
2018-10-22 06:01:51 [DEBUG   ] summary = ERROR
2018-10-22 06:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231696  13 58413 21711333 A  ERRORERROR'
2018-10-22 06:01:51 [DEBUG   ] Got command RPT from MCS: ref #231698
2018-10-22 06:01:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231698  77 58413 21711537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:01:51 [DEBUG   ] Got command RPT from MCS: ref #231699
2018-10-22 06:01:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231699  12 58413 21711741 A  ERRORB˜™š'
2018-10-22 06:02:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:02:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:02:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:02:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:02:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:02:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:02:07 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-10-22 06:02:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 06:02:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 06:02:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 06:03:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:03:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:03:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:03:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:03:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:03:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:03:07 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-22 06:03:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:03:28 [DEBUG   ] Got command RPT from MCS: ref #231708
2018-10-22 06:03:28 [DEBUG   ] summary = ERROR
2018-10-22 06:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231708  13 58413 21808809 A  ERRORERROR'
2018-10-22 06:03:28 [DEBUG   ] Got command RPT from MCS: ref #231709
2018-10-22 06:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231709  77 58413 21808810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:03:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:03:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 06:04:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:04:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:04:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:04:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:04:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:04:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:04:07 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-22 06:04:09 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-22 06:04:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 06:04:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 06:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:05:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:05:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:05:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:05:07 [WARNING ] (13, 1, 'bot')
2018-10-22 06:05:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:05:07 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-10-22 06:05:09 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-22 06:05:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 06:05:50 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-22 06:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:06:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:06:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:06:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:06:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:06:08 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-10-22 06:06:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 06:06:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 06:06:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 06:06:51 [DEBUG   ] Got command RPT from MCS: ref #231729
2018-10-22 06:06:51 [DEBUG   ] summary = ERROR
2018-10-22 06:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231729  13 58413 22011013 A  ERRORERROR'
2018-10-22 06:06:51 [DEBUG   ] Got command RPT from MCS: ref #231730
2018-10-22 06:06:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231730  77 58413 22011217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:06:51 [DEBUG   ] Got command RPT from MCS: ref #231731
2018-10-22 06:06:51 [DEBUG   ] summary = ERROR
2018-10-22 06:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231731  13 58413 22011409 A  ERRORERROR'
2018-10-22 06:06:51 [DEBUG   ] Got command RPT from MCS: ref #231732
2018-10-22 06:06:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231732  77 58413 22011613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:06:51 [DEBUG   ] Got command RPT from MCS: ref #231733
2018-10-22 06:06:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231733  12 58413 22011817 A  ERRORB—™š'
2018-10-22 06:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:07:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:07:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:07:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:07:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:07:08 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-10-22 06:07:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 06:07:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 06:07:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 06:08:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 06:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:08:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:08:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:08:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:08:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:08:08 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-10-22 06:08:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:08:28 [DEBUG   ] Got command RPT from MCS: ref #231734
2018-10-22 06:08:28 [DEBUG   ] summary = ERROR
2018-10-22 06:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231734  13 58413 22108813 A  ERRORERROR'
2018-10-22 06:08:28 [DEBUG   ] Got command RPT from MCS: ref #231735
2018-10-22 06:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231735  77 58413 22108814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:08:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:08:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 06:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:09:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:09:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:09:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:09:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:09:08 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-22 06:09:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 06:09:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 06:09:51 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-10-22 06:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 06:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:10:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:10:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:10:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:10:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:10:08 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-22 06:10:10 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-22 06:10:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 06:10:51 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-22 06:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:11:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:11:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:11:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:11:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:11:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:11:08 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-10-22 06:11:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 06:11:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 06:11:51 [DEBUG   ] Got command RPT from MCS: ref #231757
2018-10-22 06:11:51 [DEBUG   ] summary = ERROR
2018-10-22 06:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231757  13 58413 22311089 A  ERRORERROR'
2018-10-22 06:11:51 [DEBUG   ] Got command RPT from MCS: ref #231758
2018-10-22 06:11:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231758  77 58413 22311293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:11:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 06:11:51 [DEBUG   ] Got command RPT from MCS: ref #231759
2018-10-22 06:11:51 [DEBUG   ] summary = ERROR
2018-10-22 06:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231759  13 58413 22311497 A  ERRORERROR'
2018-10-22 06:11:51 [DEBUG   ] Got command RPT from MCS: ref #231761
2018-10-22 06:11:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231761  77 58413 22311689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:11:51 [DEBUG   ] Got command RPT from MCS: ref #231762
2018-10-22 06:11:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:11:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231762  12 58413 22311893 A  ERRORB—™š'
2018-10-22 06:12:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:12:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 06:12:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:12:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:12:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:12:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:12:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:12:08 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-10-22 06:12:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 06:12:31 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-22 06:12:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:13:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:13:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 06:13:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:13:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:13:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:13:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:13:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:13:08 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-10-22 06:13:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 06:13:28 [DEBUG   ] Got command RPT from MCS: ref #231771
2018-10-22 06:13:28 [DEBUG   ] summary = ERROR
2018-10-22 06:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231771  13 58413 22408809 A  ERRORERROR'
2018-10-22 06:13:28 [DEBUG   ] Got command RPT from MCS: ref #231772
2018-10-22 06:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231772  77 58413 22408810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:13:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 06:13:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 06:14:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:14:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 06:14:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:14:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:14:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:14:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:14:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:14:08 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-22 06:14:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 06:14:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 06:14:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 06:15:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:15:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 06:15:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:15:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:15:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:15:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:15:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:15:08 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-10-22 06:15:11 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-22 06:15:31 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 06:15:52 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-22 06:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:16:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:16:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:16:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:16:08 [WARNING ] (13, 1, 'bot')
2018-10-22 06:16:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:16:08 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-10-22 06:16:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 06:16:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 06:16:51 [DEBUG   ] Got command RPT from MCS: ref #231792
2018-10-22 06:16:51 [DEBUG   ] summary = ERROR
2018-10-22 06:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231792  13 58413 22611169 A  ERRORERROR'
2018-10-22 06:16:51 [DEBUG   ] Got command RPT from MCS: ref #231793
2018-10-22 06:16:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231793  77 58413 22611373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:16:51 [DEBUG   ] Got command RPT from MCS: ref #231794
2018-10-22 06:16:51 [DEBUG   ] summary = ERROR
2018-10-22 06:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231794  13 58413 22611577 A  ERRORERROR'
2018-10-22 06:16:51 [DEBUG   ] Got command RPT from MCS: ref #231795
2018-10-22 06:16:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231795  77 58413 22611781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:16:51 [DEBUG   ] Got command RPT from MCS: ref #231796
2018-10-22 06:16:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231796  12 58413 22611973 A  ERRORB™™š'
2018-10-22 06:16:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:17:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:17:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:17:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:17:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:17:09 [DEBUG   ] Finished updating board flags in 2.042 seconds
2018-10-22 06:17:12 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-10-22 06:17:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 06:17:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:18:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 06:18:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:18:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:18:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:18:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:18:09 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-10-22 06:18:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:18:28 [DEBUG   ] Got command RPT from MCS: ref #231801
2018-10-22 06:18:28 [DEBUG   ] summary = ERROR
2018-10-22 06:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231801  13 58413 22708809 A  ERRORERROR'
2018-10-22 06:18:28 [DEBUG   ] Got command RPT from MCS: ref #231802
2018-10-22 06:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231802  77 58413 22708810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:18:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 06:18:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 06:19:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 06:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:19:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:19:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:19:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:19:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:19:09 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-10-22 06:19:12 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-22 06:19:32 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-22 06:19:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-22 06:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:20:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:20:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:20:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:20:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:20:09 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-10-22 06:20:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 06:20:33 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-10-22 06:20:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 06:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:21:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:21:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:21:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:21:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:21:09 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-10-22 06:21:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 06:21:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 06:21:51 [DEBUG   ] Got command RPT from MCS: ref #231824
2018-10-22 06:21:51 [DEBUG   ] summary = ERROR
2018-10-22 06:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231824  13 58413 22911253 A  ERRORERROR'
2018-10-22 06:21:51 [DEBUG   ] Got command RPT from MCS: ref #231825
2018-10-22 06:21:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231825  77 58413 22911457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:21:51 [DEBUG   ] Got command RPT from MCS: ref #231826
2018-10-22 06:21:51 [DEBUG   ] summary = ERROR
2018-10-22 06:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231826  13 58413 22911649 A  ERRORERROR'
2018-10-22 06:21:51 [DEBUG   ] Got command RPT from MCS: ref #231828
2018-10-22 06:21:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:21:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231828  77 58413 22911853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:21:52 [DEBUG   ] Got command RPT from MCS: ref #231830
2018-10-22 06:21:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:21:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231830  12 58413 22912057 A  ERRORB™™š'
2018-10-22 06:21:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:22:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 06:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:22:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:22:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:22:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:22:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:22:09 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-10-22 06:22:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:22:33 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 06:22:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 06:23:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:23:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:23:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:23:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:23:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:23:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:23:09 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-10-22 06:23:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 06:23:28 [DEBUG   ] Got command RPT from MCS: ref #231834
2018-10-22 06:23:28 [DEBUG   ] summary = ERROR
2018-10-22 06:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231834  13 58413 23008809 A  ERRORERROR'
2018-10-22 06:23:28 [DEBUG   ] Got command RPT from MCS: ref #231835
2018-10-22 06:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231835  77 58413 23008810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:23:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-22 06:23:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 06:24:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 06:24:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:24:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:24:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:24:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:24:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:24:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:24:09 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-22 06:24:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-22 06:24:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 06:24:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 06:25:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 06:25:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:25:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:25:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:25:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:25:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:25:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:25:09 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-10-22 06:25:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 06:25:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 06:25:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 06:26:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:26:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:26:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:26:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:26:09 [WARNING ] (13, 1, 'bot')
2018-10-22 06:26:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:26:09 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-10-22 06:26:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 06:26:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:26:51 [DEBUG   ] Got command RPT from MCS: ref #231855
2018-10-22 06:26:51 [DEBUG   ] summary = ERROR
2018-10-22 06:26:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231855  13 58413 23211341 A  ERRORERROR'
2018-10-22 06:26:51 [DEBUG   ] Got command RPT from MCS: ref #231856
2018-10-22 06:26:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:26:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231856  77 58413 23211533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:26:51 [DEBUG   ] Got command RPT from MCS: ref #231857
2018-10-22 06:26:51 [DEBUG   ] summary = ERROR
2018-10-22 06:26:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231857  13 58413 23211737 A  ERRORERROR'
2018-10-22 06:26:51 [DEBUG   ] Got command RPT from MCS: ref #231858
2018-10-22 06:26:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:26:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231858  77 58413 23211941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:26:52 [DEBUG   ] Got command RPT from MCS: ref #231859
2018-10-22 06:26:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231859  12 58413 23212145 A  ERRORB˜™š'
2018-10-22 06:26:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 06:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:27:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:27:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:27:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:27:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:27:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:27:10 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-10-22 06:27:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 06:27:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 06:27:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:28:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 06:28:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:28:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:28:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:28:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:28:10 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-10-22 06:28:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:28:28 [DEBUG   ] Got command RPT from MCS: ref #231864
2018-10-22 06:28:28 [DEBUG   ] summary = ERROR
2018-10-22 06:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231864  13 58413 23308821 A  ERRORERROR'
2018-10-22 06:28:28 [DEBUG   ] Got command RPT from MCS: ref #231865
2018-10-22 06:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231865  77 58413 23308822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:28:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 06:28:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 06:29:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:29:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:29:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:29:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:29:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:29:10 [DEBUG   ] Finished updating board flags in 2.063 seconds
2018-10-22 06:29:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:29:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 06:29:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 06:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:30:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:30:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:30:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:30:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:30:10 [DEBUG   ] Finished updating board flags in 1.922 seconds
2018-10-22 06:30:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 06:30:35 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-22 06:30:55 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-22 06:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:31:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:31:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:31:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:31:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:31:10 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-10-22 06:31:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 06:31:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 06:31:51 [DEBUG   ] Got command RPT from MCS: ref #231887
2018-10-22 06:31:51 [DEBUG   ] summary = ERROR
2018-10-22 06:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231887  13 58413 23511409 A  ERRORERROR'
2018-10-22 06:31:51 [DEBUG   ] Got command RPT from MCS: ref #231888
2018-10-22 06:31:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231888  77 58413 23511613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:31:51 [DEBUG   ] Got command RPT from MCS: ref #231889
2018-10-22 06:31:51 [DEBUG   ] summary = ERROR
2018-10-22 06:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231889  13 58413 23511817 A  ERRORERROR'
2018-10-22 06:31:52 [DEBUG   ] Got command RPT from MCS: ref #231891
2018-10-22 06:31:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231891  77 58413 23512009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:31:52 [DEBUG   ] Got command RPT from MCS: ref #231892
2018-10-22 06:31:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231892  12 58413 23512213 A  ERRORB—™š'
2018-10-22 06:31:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 06:32:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:32:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:32:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:32:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:32:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:32:10 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-10-22 06:32:15 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-22 06:32:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:32:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:33:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:33:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:33:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:33:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:33:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:33:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:33:10 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-22 06:33:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:33:28 [DEBUG   ] Got command RPT from MCS: ref #231901
2018-10-22 06:33:28 [DEBUG   ] summary = ERROR
2018-10-22 06:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231901  13 58413 23608821 A  ERRORERROR'
2018-10-22 06:33:28 [DEBUG   ] Got command RPT from MCS: ref #231902
2018-10-22 06:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231902  77 58413 23608822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:33:35 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 06:33:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 06:34:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:34:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:34:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:34:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:34:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:34:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:34:10 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-10-22 06:34:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 06:34:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 06:34:55 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-22 06:35:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:35:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:35:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:35:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:35:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:35:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:35:10 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-10-22 06:35:16 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2018-10-22 06:35:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 06:35:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 06:36:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:36:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:36:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:36:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:36:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:36:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:36:10 [DEBUG   ] Finished updating board flags in 1.394 seconds
2018-10-22 06:36:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 06:36:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 06:36:51 [DEBUG   ] Got command RPT from MCS: ref #231922
2018-10-22 06:36:51 [DEBUG   ] summary = ERROR
2018-10-22 06:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231922  13 58413 23811485 A  ERRORERROR'
2018-10-22 06:36:51 [DEBUG   ] Got command RPT from MCS: ref #231923
2018-10-22 06:36:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231923  77 58413 23811689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:36:51 [DEBUG   ] Got command RPT from MCS: ref #231924
2018-10-22 06:36:51 [DEBUG   ] summary = ERROR
2018-10-22 06:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231924  13 58413 23811893 A  ERRORERROR'
2018-10-22 06:36:52 [DEBUG   ] Got command RPT from MCS: ref #231925
2018-10-22 06:36:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231925  77 58413 23812097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:36:52 [DEBUG   ] Got command RPT from MCS: ref #231926
2018-10-22 06:36:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231926  12 58413 23812289 A  ERRORB˜™š'
2018-10-22 06:36:56 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-22 06:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:37:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:37:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:37:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:37:10 [WARNING ] (13, 1, 'bot')
2018-10-22 06:37:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:37:10 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-10-22 06:37:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 06:37:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:37:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:38:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:38:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:38:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:38:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:38:11 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-22 06:38:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 06:38:28 [DEBUG   ] Got command RPT from MCS: ref #231927
2018-10-22 06:38:28 [DEBUG   ] summary = ERROR
2018-10-22 06:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231927  13 58413 23908813 A  ERRORERROR'
2018-10-22 06:38:28 [DEBUG   ] Got command RPT from MCS: ref #231928
2018-10-22 06:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231928  77 58413 23908814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:38:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 06:38:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 06:39:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 06:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:39:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 06:39:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:39:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:39:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:39:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:39:11 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-10-22 06:39:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:39:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 06:39:57 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-22 06:40:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 06:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:40:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 06:40:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:40:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:40:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:40:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:40:11 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-22 06:40:17 [DEBUG   ] Finished updating ant stats in 1.524 seconds
2018-10-22 06:40:37 [DEBUG   ] Finished updating ant stats in 1.084 seconds
2018-10-22 06:40:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 06:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:41:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 06:41:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:41:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:41:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:41:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:41:11 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-10-22 06:41:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 06:41:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 06:41:51 [DEBUG   ] Got command RPT from MCS: ref #231950
2018-10-22 06:41:51 [DEBUG   ] summary = ERROR
2018-10-22 06:41:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231950  13 58413 24111569 A  ERRORERROR'
2018-10-22 06:41:51 [DEBUG   ] Got command RPT from MCS: ref #231951
2018-10-22 06:41:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:41:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231951  77 58413 24111773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:41:51 [DEBUG   ] Got command RPT from MCS: ref #231952
2018-10-22 06:41:51 [DEBUG   ] summary = ERROR
2018-10-22 06:41:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231952  13 58413 24111977 A  ERRORERROR'
2018-10-22 06:41:52 [DEBUG   ] Got command RPT from MCS: ref #231954
2018-10-22 06:41:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231954  77 58413 24112169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:41:52 [DEBUG   ] Got command RPT from MCS: ref #231955
2018-10-22 06:41:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231955  12 58413 24112373 A  ERRORB™™š'
2018-10-22 06:41:57 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-22 06:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:42:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:42:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:42:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:42:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:42:11 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-10-22 06:42:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 06:42:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:42:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 06:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:43:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 06:43:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:43:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:43:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:43:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:43:11 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-22 06:43:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 06:43:28 [DEBUG   ] Got command RPT from MCS: ref #231964
2018-10-22 06:43:28 [DEBUG   ] summary = ERROR
2018-10-22 06:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231964  13 58413 24208821 A  ERRORERROR'
2018-10-22 06:43:28 [DEBUG   ] Got command RPT from MCS: ref #231965
2018-10-22 06:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231965  77 58413 24208822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:43:37 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2018-10-22 06:43:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 06:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:44:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:44:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:44:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:44:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:44:11 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-10-22 06:44:17 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-22 06:44:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 06:44:57 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-22 06:45:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 06:45:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:45:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:45:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:45:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:45:11 [WARNING ] (13, 1, 'bot')
2018-10-22 06:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:45:11 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-10-22 06:45:18 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-22 06:45:38 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-22 06:45:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 06:46:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:46:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:46:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:46:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:46:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:46:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:46:12 [DEBUG   ] Finished updating board flags in 2.199 seconds
2018-10-22 06:46:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 06:46:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 06:46:51 [DEBUG   ] Got command RPT from MCS: ref #231985
2018-10-22 06:46:51 [DEBUG   ] summary = ERROR
2018-10-22 06:46:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231985  13 58413 24411649 A  ERRORERROR'
2018-10-22 06:46:51 [DEBUG   ] Got command RPT from MCS: ref #231986
2018-10-22 06:46:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:46:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231986  77 58413 24411853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:46:52 [DEBUG   ] Got command RPT from MCS: ref #231987
2018-10-22 06:46:52 [DEBUG   ] summary = ERROR
2018-10-22 06:46:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231987  13 58413 24412057 A  ERRORERROR'
2018-10-22 06:46:52 [DEBUG   ] Got command RPT from MCS: ref #231988
2018-10-22 06:46:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:46:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231988  77 58413 24412249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:46:52 [DEBUG   ] Got command RPT from MCS: ref #231989
2018-10-22 06:46:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:46:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231989  12 58413 24412453 A  ERRORB˜™š'
2018-10-22 06:46:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 06:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:47:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:47:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:47:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:47:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:47:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:47:12 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-22 06:47:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 06:47:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 06:47:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 06:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:48:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:48:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:48:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:48:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:48:12 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-22 06:48:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 06:48:28 [DEBUG   ] Got command RPT from MCS: ref #231994
2018-10-22 06:48:28 [DEBUG   ] summary = ERROR
2018-10-22 06:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231994  13 58413 24508825 A  ERRORERROR'
2018-10-22 06:48:28 [DEBUG   ] Got command RPT from MCS: ref #231995
2018-10-22 06:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   231995  77 58413 24508826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:48:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 06:48:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 06:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:49:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 06:49:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:49:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:49:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:49:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:49:12 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-10-22 06:49:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 06:49:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 06:49:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 06:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:50:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:50:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:50:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:50:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:50:12 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-10-22 06:50:18 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-10-22 06:50:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-22 06:50:59 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-22 06:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:51:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:51:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:51:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:51:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:51:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:51:12 [DEBUG   ] Finished updating board flags in 1.776 seconds
2018-10-22 06:51:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 06:51:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 06:51:51 [DEBUG   ] Got command RPT from MCS: ref #232017
2018-10-22 06:51:51 [DEBUG   ] summary = ERROR
2018-10-22 06:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232017  13 58413 24711733 A  ERRORERROR'
2018-10-22 06:51:51 [DEBUG   ] Got command RPT from MCS: ref #232018
2018-10-22 06:51:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:51:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232018  77 58413 24711937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:51:52 [DEBUG   ] Got command RPT from MCS: ref #232019
2018-10-22 06:51:52 [DEBUG   ] summary = ERROR
2018-10-22 06:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232019  13 58413 24712129 A  ERRORERROR'
2018-10-22 06:51:52 [DEBUG   ] Got command RPT from MCS: ref #232021
2018-10-22 06:51:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232021  77 58413 24712333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:51:52 [DEBUG   ] Got command RPT from MCS: ref #232022
2018-10-22 06:51:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232022  12 58413 24712537 A  ERRORB˜™š'
2018-10-22 06:51:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 06:52:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 06:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:52:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:52:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:52:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:52:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:52:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:52:12 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-22 06:52:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 06:52:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 06:52:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 06:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:53:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:53:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:53:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:53:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:53:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:53:12 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-10-22 06:53:19 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-22 06:53:28 [DEBUG   ] Got command RPT from MCS: ref #232027
2018-10-22 06:53:28 [DEBUG   ] summary = ERROR
2018-10-22 06:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232027  13 58413 24808825 A  ERRORERROR'
2018-10-22 06:53:28 [DEBUG   ] Got command RPT from MCS: ref #232028
2018-10-22 06:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232028  77 58413 24808826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:53:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:53:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:54:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:54:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:54:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:54:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:54:12 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-22 06:54:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 06:54:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 06:54:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 06:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:55:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:55:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:55:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:55:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:55:12 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-10-22 06:55:19 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2018-10-22 06:55:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-22 06:56:00 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-22 06:56:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:56:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:56:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:56:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:56:12 [WARNING ] (13, 1, 'bot')
2018-10-22 06:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:56:12 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-10-22 06:56:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 06:56:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 06:56:51 [DEBUG   ] Got command RPT from MCS: ref #232048
2018-10-22 06:56:51 [DEBUG   ] summary = ERROR
2018-10-22 06:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232048  13 58413 25011809 A  ERRORERROR'
2018-10-22 06:56:52 [DEBUG   ] Got command RPT from MCS: ref #232049
2018-10-22 06:56:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232049  77 58413 25012013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:56:52 [DEBUG   ] Got command RPT from MCS: ref #232050
2018-10-22 06:56:52 [DEBUG   ] summary = ERROR
2018-10-22 06:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232050  13 58413 25012217 A  ERRORERROR'
2018-10-22 06:56:52 [DEBUG   ] Got command RPT from MCS: ref #232051
2018-10-22 06:56:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232051  77 58413 25012409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:56:52 [DEBUG   ] Got command RPT from MCS: ref #232052
2018-10-22 06:56:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 06:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232052  12 58413 25012613 A  ERRORB—™š'
2018-10-22 06:57:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 06:57:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:57:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:57:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:57:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:57:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:57:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:57:13 [DEBUG   ] Finished updating board flags in 2.066 seconds
2018-10-22 06:57:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 06:57:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 06:58:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 06:58:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:58:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 06:58:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:58:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:58:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:58:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:58:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:58:13 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-22 06:58:20 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 06:58:28 [DEBUG   ] Got command RPT from MCS: ref #232057
2018-10-22 06:58:28 [DEBUG   ] summary = ERROR
2018-10-22 06:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232057  13 58413 25108821 A  ERRORERROR'
2018-10-22 06:58:28 [DEBUG   ] Got command RPT from MCS: ref #232058
2018-10-22 06:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 06:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232058  77 58413 25108822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 06:58:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 06:59:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 06:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 06:59:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 06:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 06:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 06:59:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:59:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:59:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:59:13 [WARNING ] (13, 1, 'bot')
2018-10-22 06:59:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 06:59:13 [DEBUG   ] Finished updating board flags in 1.861 seconds
2018-10-22 06:59:20 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-10-22 06:59:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 07:00:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 07:00:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:00:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:00:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:00:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:00:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:00:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:00:13 [DEBUG   ] Finished updating board flags in 1.756 seconds
2018-10-22 07:00:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 07:00:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 07:01:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 07:01:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:01:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:01:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:01:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:01:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:01:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:01:13 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-22 07:01:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 07:01:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 07:01:51 [DEBUG   ] Got command RPT from MCS: ref #232080
2018-10-22 07:01:51 [DEBUG   ] summary = ERROR
2018-10-22 07:01:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232080  13 58413 25311897 A  ERRORERROR'
2018-10-22 07:01:52 [DEBUG   ] Got command RPT from MCS: ref #232081
2018-10-22 07:01:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232081  77 58413 25312089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:01:52 [DEBUG   ] Got command RPT from MCS: ref #232082
2018-10-22 07:01:52 [DEBUG   ] summary = ERROR
2018-10-22 07:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232082  13 58413 25312293 A  ERRORERROR'
2018-10-22 07:01:52 [DEBUG   ] Got command RPT from MCS: ref #232084
2018-10-22 07:01:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232084  77 58413 25312497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:01:52 [DEBUG   ] Got command RPT from MCS: ref #232085
2018-10-22 07:01:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 07:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232085  12 58413 25312689 A  ERRORB™™š'
2018-10-22 07:02:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-22 07:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:02:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:02:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:02:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:02:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:02:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:02:13 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-10-22 07:02:20 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-22 07:02:41 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-22 07:03:01 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-10-22 07:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:03:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:03:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:03:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:03:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:03:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:03:13 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-10-22 07:03:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 07:03:28 [DEBUG   ] Got command RPT from MCS: ref #232094
2018-10-22 07:03:28 [DEBUG   ] summary = ERROR
2018-10-22 07:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232094  13 58413 25408825 A  ERRORERROR'
2018-10-22 07:03:28 [DEBUG   ] Got command RPT from MCS: ref #232095
2018-10-22 07:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232095  77 58413 25408826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:03:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 07:04:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 07:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:04:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 07:04:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:04:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:04:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:04:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:04:13 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-22 07:04:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 07:04:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 07:05:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 07:05:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 07:05:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:05:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 07:05:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:05:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:05:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:05:13 [WARNING ] (13, 1, 'bot')
2018-10-22 07:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:05:13 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-10-22 07:05:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 07:05:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 07:06:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-10-22 07:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 07:06:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:06:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:06:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:06:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:06:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:06:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:06:14 [DEBUG   ] Finished updating board flags in 2.182 seconds
2018-10-22 07:06:21 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-10-22 07:06:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 07:06:51 [DEBUG   ] Got command RPT from MCS: ref #232115
2018-10-22 07:06:51 [DEBUG   ] summary = ERROR
2018-10-22 07:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232115  13 58413 25611973 A  ERRORERROR'
2018-10-22 07:06:52 [DEBUG   ] Got command RPT from MCS: ref #232116
2018-10-22 07:06:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232116  77 58413 25612177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:06:52 [DEBUG   ] Got command RPT from MCS: ref #232117
2018-10-22 07:06:52 [DEBUG   ] summary = ERROR
2018-10-22 07:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232117  13 58413 25612369 A  ERRORERROR'
2018-10-22 07:06:52 [DEBUG   ] Got command RPT from MCS: ref #232118
2018-10-22 07:06:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232118  77 58413 25612573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:06:52 [DEBUG   ] Got command RPT from MCS: ref #232119
2018-10-22 07:06:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 07:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232119  12 58413 25612777 A  ERRORB™™š'
2018-10-22 07:07:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 07:07:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:07:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 07:07:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:07:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:07:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:07:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:07:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:07:14 [DEBUG   ] Finished updating board flags in 1.972 seconds
2018-10-22 07:07:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 07:07:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 07:08:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 07:08:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 07:08:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:08:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:08:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:08:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:08:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:08:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:08:14 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-10-22 07:08:21 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-10-22 07:08:28 [DEBUG   ] Got command RPT from MCS: ref #232120
2018-10-22 07:08:28 [DEBUG   ] summary = ERROR
2018-10-22 07:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232120  13 58413 25708821 A  ERRORERROR'
2018-10-22 07:08:28 [DEBUG   ] Got command RPT from MCS: ref #232121
2018-10-22 07:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232121  77 58413 25708822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:08:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-22 07:09:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-10-22 07:09:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:09:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:09:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:09:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:09:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:09:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:09:14 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-10-22 07:09:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 07:09:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 07:10:02 [DEBUG   ] Finished updating ant stats in 1.562 seconds
2018-10-22 07:10:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:10:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:10:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:10:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:10:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:10:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:10:14 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-22 07:10:22 [DEBUG   ] Finished updating ant stats in 1.040 seconds
2018-10-22 07:10:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 07:11:02 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 07:11:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:11:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:11:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:11:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:11:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:11:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:11:14 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-22 07:11:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 07:11:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 07:11:52 [DEBUG   ] Got command RPT from MCS: ref #232143
2018-10-22 07:11:52 [DEBUG   ] summary = ERROR
2018-10-22 07:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232143  13 58413 25912057 A  ERRORERROR'
2018-10-22 07:11:52 [DEBUG   ] Got command RPT from MCS: ref #232144
2018-10-22 07:11:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232144  77 58413 25912249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:11:52 [DEBUG   ] Got command RPT from MCS: ref #232145
2018-10-22 07:11:52 [DEBUG   ] summary = ERROR
2018-10-22 07:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232145  13 58413 25912453 A  ERRORERROR'
2018-10-22 07:11:52 [DEBUG   ] Got command RPT from MCS: ref #232147
2018-10-22 07:11:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232147  77 58413 25912657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:11:52 [DEBUG   ] Got command RPT from MCS: ref #232148
2018-10-22 07:11:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 07:11:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232148  12 58413 25912849 A  ERRORB˜™š'
2018-10-22 07:12:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 07:12:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:12:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:12:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:12:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:12:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:12:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:12:14 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-10-22 07:12:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 07:12:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 07:13:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 07:13:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 07:13:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:13:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:13:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:13:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:13:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:13:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:13:14 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-10-22 07:13:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 07:13:28 [DEBUG   ] Got command RPT from MCS: ref #232157
2018-10-22 07:13:28 [DEBUG   ] summary = ERROR
2018-10-22 07:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232157  13 58413 26008829 A  ERRORERROR'
2018-10-22 07:13:28 [DEBUG   ] Got command RPT from MCS: ref #232158
2018-10-22 07:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232158  77 58413 26008830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:13:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 07:14:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 07:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 07:14:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 07:14:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:14:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:14:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:14:14 [WARNING ] (13, 1, 'bot')
2018-10-22 07:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:14:14 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-10-22 07:14:23 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-10-22 07:14:42 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-22 07:15:03 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-10-22 07:15:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:15:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:15:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:15:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:15:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:15:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:15:15 [DEBUG   ] Finished updating board flags in 2.062 seconds
2018-10-22 07:15:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 07:15:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 07:16:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 07:16:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:16:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:16:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:16:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:16:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:16:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:16:15 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-22 07:16:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 07:16:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 07:16:52 [DEBUG   ] Got command RPT from MCS: ref #232178
2018-10-22 07:16:52 [DEBUG   ] summary = ERROR
2018-10-22 07:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232178  13 58413 26212129 A  ERRORERROR'
2018-10-22 07:16:52 [DEBUG   ] Got command RPT from MCS: ref #232179
2018-10-22 07:16:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232179  77 58413 26212333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:16:52 [DEBUG   ] Got command RPT from MCS: ref #232180
2018-10-22 07:16:52 [DEBUG   ] summary = ERROR
2018-10-22 07:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232180  13 58413 26212537 A  ERRORERROR'
2018-10-22 07:16:52 [DEBUG   ] Got command RPT from MCS: ref #232181
2018-10-22 07:16:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232181  77 58413 26212741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:16:52 [DEBUG   ] Got command RPT from MCS: ref #232182
2018-10-22 07:16:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 07:16:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232182  12 58413 26212933 A  ERRORB˜™š'
2018-10-22 07:17:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 07:17:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 07:17:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:17:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:17:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:17:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:17:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:17:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:17:15 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-10-22 07:17:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 07:17:43 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 07:18:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 07:18:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:18:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:18:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:18:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:18:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:18:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:18:15 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-22 07:18:23 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 07:18:28 [DEBUG   ] Got command RPT from MCS: ref #232187
2018-10-22 07:18:28 [DEBUG   ] summary = ERROR
2018-10-22 07:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232187  13 58413 26308833 A  ERRORERROR'
2018-10-22 07:18:28 [DEBUG   ] Got command RPT from MCS: ref #232188
2018-10-22 07:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232188  77 58413 26308834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:18:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 07:19:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 07:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-22 07:19:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:19:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:19:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:19:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:19:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:19:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:19:15 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-22 07:19:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 07:19:44 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 07:20:03 [DEBUG   ] Finished updating ant stats in 0.770 seconds
2018-10-22 07:20:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:20:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:20:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:20:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:20:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:20:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:20:15 [DEBUG   ] Finished updating board flags in 1.644 seconds
2018-10-22 07:20:24 [DEBUG   ] Finished updating ant stats in 1.240 seconds
2018-10-22 07:20:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 07:21:04 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-10-22 07:21:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:21:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:21:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:21:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:21:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:21:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:21:15 [DEBUG   ] Finished updating board flags in 1.533 seconds
2018-10-22 07:21:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 07:21:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 07:21:52 [DEBUG   ] Got command RPT from MCS: ref #232210
2018-10-22 07:21:52 [DEBUG   ] summary = ERROR
2018-10-22 07:21:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232210  13 58413 26512209 A  ERRORERROR'
2018-10-22 07:21:52 [DEBUG   ] Got command RPT from MCS: ref #232211
2018-10-22 07:21:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:21:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232211  77 58413 26512413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:21:52 [DEBUG   ] Got command RPT from MCS: ref #232212
2018-10-22 07:21:52 [DEBUG   ] summary = ERROR
2018-10-22 07:21:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232212  13 58413 26512617 A  ERRORERROR'
2018-10-22 07:21:52 [DEBUG   ] Got command RPT from MCS: ref #232214
2018-10-22 07:21:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:21:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232214  77 58413 26512821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:21:53 [DEBUG   ] Got command RPT from MCS: ref #232216
2018-10-22 07:21:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 07:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232216  12 58413 26513013 A  ERRORB—™š'
2018-10-22 07:22:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 07:22:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 07:22:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:22:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:22:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:22:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:22:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:22:15 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-10-22 07:22:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 07:22:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 07:23:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-10-22 07:23:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:23:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:23:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:23:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:23:15 [WARNING ] (13, 1, 'bot')
2018-10-22 07:23:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:23:15 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-10-22 07:23:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 07:23:28 [DEBUG   ] Got command RPT from MCS: ref #232220
2018-10-22 07:23:28 [DEBUG   ] summary = ERROR
2018-10-22 07:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232220  13 58413 26608825 A  ERRORERROR'
2018-10-22 07:23:28 [DEBUG   ] Got command RPT from MCS: ref #232221
2018-10-22 07:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232221  77 58413 26608826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:23:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 07:24:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 07:24:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:24:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:24:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:24:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:24:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:24:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:24:16 [DEBUG   ] Finished updating board flags in 2.247 seconds
2018-10-22 07:24:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 07:24:44 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-22 07:25:05 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-22 07:25:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:25:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:25:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:25:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:25:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:25:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:25:16 [DEBUG   ] Finished updating board flags in 2.148 seconds
2018-10-22 07:25:25 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-10-22 07:25:45 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-10-22 07:26:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 07:26:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:26:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:26:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:26:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:26:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:26:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:26:16 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-10-22 07:26:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 07:26:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 07:26:52 [DEBUG   ] Got command RPT from MCS: ref #232241
2018-10-22 07:26:52 [DEBUG   ] summary = ERROR
2018-10-22 07:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232241  13 58413 26812293 A  ERRORERROR'
2018-10-22 07:26:52 [DEBUG   ] Got command RPT from MCS: ref #232242
2018-10-22 07:26:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232242  77 58413 26812497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:26:52 [DEBUG   ] Got command RPT from MCS: ref #232243
2018-10-22 07:26:52 [DEBUG   ] summary = ERROR
2018-10-22 07:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232243  13 58413 26812689 A  ERRORERROR'
2018-10-22 07:26:52 [DEBUG   ] Got command RPT from MCS: ref #232244
2018-10-22 07:26:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:26:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232244  77 58413 26812893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:26:53 [DEBUG   ] Got command RPT from MCS: ref #232245
2018-10-22 07:26:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 07:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232245  12 58413 26813097 A  ERRORB™™š'
2018-10-22 07:27:05 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 07:27:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:27:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:27:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:27:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:27:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:27:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:27:16 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-10-22 07:27:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 07:27:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 07:28:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 07:28:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 07:28:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:28:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:28:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:28:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:28:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:28:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:28:16 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-10-22 07:28:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 07:28:28 [DEBUG   ] Got command RPT from MCS: ref #232250
2018-10-22 07:28:28 [DEBUG   ] summary = ERROR
2018-10-22 07:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232250  13 58413 26908829 A  ERRORERROR'
2018-10-22 07:28:28 [DEBUG   ] Got command RPT from MCS: ref #232251
2018-10-22 07:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232251  77 58413 26908830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:28:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 07:29:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 07:29:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:29:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:29:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:29:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:29:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:29:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:29:16 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-10-22 07:29:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 07:29:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 07:30:06 [DEBUG   ] Finished updating ant stats in 1.610 seconds
2018-10-22 07:30:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:30:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 07:30:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:30:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:30:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:30:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:30:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:30:16 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-22 07:30:25 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2018-10-22 07:30:46 [DEBUG   ] Finished updating ant stats in 1.405 seconds
2018-10-22 07:31:05 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 07:31:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:31:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:31:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:31:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:31:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:31:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:31:16 [DEBUG   ] Finished updating board flags in 1.666 seconds
2018-10-22 07:31:25 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-22 07:31:45 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-10-22 07:31:52 [DEBUG   ] Got command RPT from MCS: ref #232273
2018-10-22 07:31:52 [DEBUG   ] summary = ERROR
2018-10-22 07:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232273  13 58413 27112373 A  ERRORERROR'
2018-10-22 07:31:52 [DEBUG   ] Got command RPT from MCS: ref #232274
2018-10-22 07:31:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232274  77 58413 27112577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:31:52 [DEBUG   ] Got command RPT from MCS: ref #232275
2018-10-22 07:31:52 [DEBUG   ] summary = ERROR
2018-10-22 07:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232275  13 58413 27112781 A  ERRORERROR'
2018-10-22 07:31:52 [DEBUG   ] Got command RPT from MCS: ref #232277
2018-10-22 07:31:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 07:31:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232277  77 58413 27112973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 07:31:53 [DEBUG   ] Got command RPT from MCS: ref #232278
2018-10-22 07:31:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 07:31:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232278  12 58413 27113177 A  ERRORB™™š'
2018-10-22 07:32:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 07:32:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 07:32:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:32:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:32:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:32:16 [WARNING ] (13, 1, 'bot')
2018-10-22 07:32:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 07:32:16 [DEBUG   ] Finished updating board flags in 1.528 seconds
2018-10-22 07:32:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 07:32:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 07:33:06 [DEBUG   ] Got command RPT from MCS: ref #232287
2018-10-22 07:33:06 [DEBUG   ] summary = ERROR
2018-10-22 07:33:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232287  13 58413 27186209 A  ERRORERROR'
2018-10-22 07:33:06 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-10-22 07:33:06 [DEBUG   ] Got command SHT from MCS: ref #232289
2018-10-22 07:33:06 [DEBUG   ] Stopping antenna statistics
2018-10-22 07:33:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_SHT   232289   8 58413 27186609 ASHUTDWN'
2018-10-22 07:33:08 [DEBUG   ] Stopping beam statistics
2018-10-22 07:33:08 [DEBUG   ] Stopping monitoring flags
2018-10-22 07:33:08 [DEBUG   ] Stopping BAM updater
2018-10-22 07:33:08 [DEBUG   ] Stopping DRX time setter
2018-10-22 07:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh with timeout 10 s
2018-10-22 07:33:19 [DEBUG   ] run_process: at 2018-10-22 07:33:19 running ['/usr/local/bin/lwa16', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:19 [DEBUG   ] run_process: at 2018-10-22 07:33:19 running ['/usr/local/bin/lwa27', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:19 [DEBUG   ] run_process: at 2018-10-22 07:33:19 running ['/usr/local/bin/lwa24', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:19 [DEBUG   ] run_process: at 2018-10-22 07:33:19 running ['/usr/local/bin/lwa23', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:19 [DEBUG   ] run_process: at 2018-10-22 07:33:19 running ['/usr/local/bin/lwa18', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:19 [DEBUG   ] run_process: at 2018-10-22 07:33:19 running ['/usr/local/bin/lwa10', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:19 [DEBUG   ] run_process: at 2018-10-22 07:33:19 running ['/usr/local/bin/lwa32', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:20 [DEBUG   ] run_process: at 2018-10-22 07:33:20 running ['/usr/local/bin/lwa11', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:20 [DEBUG   ] run_process: at 2018-10-22 07:33:20 running ['/usr/local/bin/lwa30', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:20 [DEBUG   ] run_process: at 2018-10-22 07:33:20 running ['/usr/local/bin/lwa12', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:20 [DEBUG   ] run_process: at 2018-10-22 07:33:20 running ['/usr/local/bin/lwa8', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:20 [DEBUG   ] run_process: at 2018-10-22 07:33:20 running ['/usr/local/bin/lwa13', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:20 [DEBUG   ] run_process: at 2018-10-22 07:33:20 running ['/usr/local/bin/lwa26', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:20 [DEBUG   ] run_process: at 2018-10-22 07:33:20 running ['/usr/local/bin/lwa14', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:20 [DEBUG   ] run_process: at 2018-10-22 07:33:20 running ['/usr/local/bin/lwa34', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:21 [DEBUG   ] run_process: at 2018-10-22 07:33:21 running ['/usr/local/bin/lwa22', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:21 [DEBUG   ] run_process: at 2018-10-22 07:33:21 running ['/usr/local/bin/lwa20', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:21 [DEBUG   ] run_process: at 2018-10-22 07:33:21 running ['/usr/local/bin/lwa1', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:21 [DEBUG   ] run_process: at 2018-10-22 07:33:21 running ['/usr/local/bin/lwa5', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:21 [DEBUG   ] run_process: at 2018-10-22 07:33:21 running ['/usr/local/bin/lwa25', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:21 [DEBUG   ] run_process: at 2018-10-22 07:33:21 running ['/usr/local/bin/lwa35', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:21 [DEBUG   ] run_process: at 2018-10-22 07:33:21 running ['/usr/local/bin/lwa19', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:21 [DEBUG   ] run_process: at 2018-10-22 07:33:21 running ['/usr/local/bin/lwa21', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:21 [DEBUG   ] run_process: at 2018-10-22 07:33:21 running ['/usr/local/bin/lwa6', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:22 [DEBUG   ] run_process: at 2018-10-22 07:33:22 running ['/usr/local/bin/lwa7', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:22 [DEBUG   ] run_process: at 2018-10-22 07:33:22 running ['/usr/local/bin/lwa33', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:22 [DEBUG   ] run_process: at 2018-10-22 07:33:22 running ['/usr/local/bin/lwa15', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:22 [DEBUG   ] run_process: at 2018-10-22 07:33:22 running ['/usr/local/bin/lwa28', '/lwa/software/Shutdown.sh']
2018-10-22 07:33:22 [INFO    ] Finished the SHT process in 15.911 s
2018-10-22 07:33:28 [DEBUG   ] Got command RPT from MCS: ref #232301
2018-10-22 07:33:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 07:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232301  15 58413 27208829 ASHUTDWNSHUTDWN'
2018-10-22 07:33:28 [DEBUG   ] Got command RPT from MCS: ref #232302
2018-10-22 07:33:28 [DEBUG   ] info = System has been shut down
2018-10-22 07:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232302  33 58413 27208830 ASHUTDWNSystem has been shut down'
2018-10-22 07:36:52 [DEBUG   ] Got command RPT from MCS: ref #232332
2018-10-22 07:36:52 [DEBUG   ] summary = SHUTDWN
2018-10-22 07:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232332  15 58413 27412461 ASHUTDWNSHUTDWN'
2018-10-22 07:38:28 [DEBUG   ] Got command RPT from MCS: ref #232333
2018-10-22 07:38:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 07:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232333  15 58413 27508833 ASHUTDWNSHUTDWN'
2018-10-22 07:38:28 [DEBUG   ] Got command RPT from MCS: ref #232334
2018-10-22 07:38:28 [DEBUG   ] info = System has been shut down
2018-10-22 07:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232334  33 58413 27508834 ASHUTDWNSystem has been shut down'
2018-10-22 07:41:52 [DEBUG   ] Got command RPT from MCS: ref #232366
2018-10-22 07:41:52 [DEBUG   ] summary = SHUTDWN
2018-10-22 07:41:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232366  15 58413 27712537 ASHUTDWNSHUTDWN'
2018-10-22 07:43:28 [DEBUG   ] Got command RPT from MCS: ref #232386
2018-10-22 07:43:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 07:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232386  15 58413 27808837 ASHUTDWNSHUTDWN'
2018-10-22 07:43:28 [DEBUG   ] Got command RPT from MCS: ref #232387
2018-10-22 07:43:28 [DEBUG   ] info = System has been shut down
2018-10-22 07:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232387  33 58413 27808838 ASHUTDWNSystem has been shut down'
2018-10-22 07:46:52 [DEBUG   ] Got command RPT from MCS: ref #232417
2018-10-22 07:46:52 [DEBUG   ] summary = SHUTDWN
2018-10-22 07:46:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232417  15 58413 28012613 ASHUTDWNSHUTDWN'
2018-10-22 07:48:28 [DEBUG   ] Got command RPT from MCS: ref #232432
2018-10-22 07:48:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 07:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232432  15 58413 28108837 ASHUTDWNSHUTDWN'
2018-10-22 07:48:28 [DEBUG   ] Got command RPT from MCS: ref #232433
2018-10-22 07:48:28 [DEBUG   ] info = System has been shut down
2018-10-22 07:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232433  33 58413 28108838 ASHUTDWNSystem has been shut down'
2018-10-22 07:51:52 [DEBUG   ] Got command RPT from MCS: ref #232465
2018-10-22 07:51:52 [DEBUG   ] summary = SHUTDWN
2018-10-22 07:51:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232465  15 58413 28312685 ASHUTDWNSHUTDWN'
2018-10-22 07:53:28 [DEBUG   ] Got command RPT from MCS: ref #232471
2018-10-22 07:53:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 07:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232471  15 58413 28408841 ASHUTDWNSHUTDWN'
2018-10-22 07:53:28 [DEBUG   ] Got command RPT from MCS: ref #232472
2018-10-22 07:53:28 [DEBUG   ] info = System has been shut down
2018-10-22 07:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232472  33 58413 28408842 ASHUTDWNSystem has been shut down'
2018-10-22 07:56:52 [DEBUG   ] Got command RPT from MCS: ref #232502
2018-10-22 07:56:52 [DEBUG   ] summary = SHUTDWN
2018-10-22 07:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232502  15 58413 28612769 ASHUTDWNSHUTDWN'
2018-10-22 07:58:28 [DEBUG   ] Got command RPT from MCS: ref #232518
2018-10-22 07:58:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 07:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232518  15 58413 28708841 ASHUTDWNSHUTDWN'
2018-10-22 07:58:28 [DEBUG   ] Got command RPT from MCS: ref #232519
2018-10-22 07:58:28 [DEBUG   ] info = System has been shut down
2018-10-22 07:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232519  33 58413 28708842 ASHUTDWNSystem has been shut down'
2018-10-22 08:01:52 [DEBUG   ] Got command RPT from MCS: ref #232552
2018-10-22 08:01:52 [DEBUG   ] summary = SHUTDWN
2018-10-22 08:01:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232552  15 58413 28912845 ASHUTDWNSHUTDWN'
2018-10-22 08:03:28 [DEBUG   ] Got command RPT from MCS: ref #232573
2018-10-22 08:03:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 08:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232573  15 58413 29008845 ASHUTDWNSHUTDWN'
2018-10-22 08:03:28 [DEBUG   ] Got command RPT from MCS: ref #232574
2018-10-22 08:03:28 [DEBUG   ] info = System has been shut down
2018-10-22 08:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232574  33 58413 29008846 ASHUTDWNSystem has been shut down'
2018-10-22 08:06:52 [DEBUG   ] Got command RPT from MCS: ref #232605
2018-10-22 08:06:52 [DEBUG   ] summary = SHUTDWN
2018-10-22 08:06:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232605  15 58413 29212918 ASHUTDWNSHUTDWN'
2018-10-22 08:08:28 [DEBUG   ] Got command RPT from MCS: ref #232606
2018-10-22 08:08:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 08:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232606  15 58413 29308845 ASHUTDWNSHUTDWN'
2018-10-22 08:08:28 [DEBUG   ] Got command RPT from MCS: ref #232607
2018-10-22 08:08:28 [DEBUG   ] info = System has been shut down
2018-10-22 08:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232607  33 58413 29308846 ASHUTDWNSystem has been shut down'
2018-10-22 08:11:53 [DEBUG   ] Got command RPT from MCS: ref #232640
2018-10-22 08:11:53 [DEBUG   ] summary = SHUTDWN
2018-10-22 08:11:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232640  15 58413 29513001 ASHUTDWNSHUTDWN'
2018-10-22 08:13:28 [DEBUG   ] Got command RPT from MCS: ref #232661
2018-10-22 08:13:28 [DEBUG   ] summary = SHUTDWN
2018-10-22 08:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232661  15 58413 29608845 ASHUTDWNSHUTDWN'
2018-10-22 08:13:28 [DEBUG   ] Got command RPT from MCS: ref #232662
2018-10-22 08:13:28 [DEBUG   ] info = System has been shut down
2018-10-22 08:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232662  33 58413 29608846 ASHUTDWNSystem has been shut down'
2018-10-22 08:16:00 [DEBUG   ] Got command RPT from MCS: ref #232683
2018-10-22 08:16:00 [DEBUG   ] summary = SHUTDWN
2018-10-22 08:16:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232683  15 58413 29760154 ASHUTDWNSHUTDWN'
2018-10-22 08:16:00 [DEBUG   ] Got command RPT from MCS: ref #232684
2018-10-22 08:16:00 [DEBUG   ] info = System has been shut down
2018-10-22 08:16:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232684  33 58413 29760154 ASHUTDWNSystem has been shut down'
2018-10-22 08:16:05 [DEBUG   ] Got command INI from MCS: ref #232685
2018-10-22 08:16:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-10-22 08:16:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   232685   8 58413 29765162 ABOOTING'
2018-10-22 08:16:24 [INFO    ] -------------------
2018-10-22 08:16:24 [INFO    ]  LWA board status
2018-10-22 08:16:24 [INFO    ] -------------------
2018-10-22 08:16:24 [INFO    ] DP 1: 2 lwa27
2018-10-22 08:16:24 [INFO    ] DP 1: 3 lwa24
2018-10-22 08:16:24 [INFO    ] DP 1: 4 lwa23
2018-10-22 08:16:24 [INFO    ] DP 1: 5 lwa18
2018-10-22 08:16:24 [INFO    ] DP 1: 6 lwa10
2018-10-22 08:16:24 [INFO    ] DP 1: 7 lwa32
2018-10-22 08:16:24 [INFO    ] DP 1: 8 lwa11
2018-10-22 08:16:24 [INFO    ] DP 1: 9 lwa30
2018-10-22 08:16:24 [INFO    ] DP 1: 10 lwa12
2018-10-22 08:16:24 [INFO    ] DP 1: 11 lwa8
2018-10-22 08:16:24 [INFO    ] DP 1: 12 lwa13
2018-10-22 08:16:24 [INFO    ] DP 1: 13 lwa26
2018-10-22 08:16:24 [INFO    ] DP 1: 14 lwa14
2018-10-22 08:16:24 [INFO    ] DP 1: 16 lwa22
2018-10-22 08:16:24 [INFO    ] DP 1: 17 lwa20
2018-10-22 08:16:24 [INFO    ] DP 1: 18 lwa1
2018-10-22 08:16:24 [INFO    ] DP 1: 19 lwa5
2018-10-22 08:16:24 [INFO    ] DP 1: 20 lwa25
2018-10-22 08:16:24 [INFO    ] DP 1: 21 lwa35
2018-10-22 08:16:24 [INFO    ] DP 1: 22 lwa19
2018-10-22 08:16:24 [INFO    ] DP 1: 23 lwa21
2018-10-22 08:16:24 [INFO    ] DP 1: 24 lwa6
2018-10-22 08:16:24 [INFO    ] DP 1: 25 lwa7
2018-10-22 08:16:24 [INFO    ] DP 1: 26 lwa33
2018-10-22 08:16:24 [INFO    ] DP 1: 27 lwa15
2018-10-22 08:16:24 [INFO    ] DP 1: 28 lwa28
2018-10-22 08:16:24 [INFO    ] DP 2: 1 lwa16
2018-10-22 08:16:24 [INFO    ] DP 2: 15 lwa34
2018-10-22 08:16:24 [INFO    ] Total of 28 boards
2018-10-22 08:16:24 [INFO    ] Total of 260 stands
2018-10-22 08:16:24 [INFO    ] -------------------
2018-10-22 08:16:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30774
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30775
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30776
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30777
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30778
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30779
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30780
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30781
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30782
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30783
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30784
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30785
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30786
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30787
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30788
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30789
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30790
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30791
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30792
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30793
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30794
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30795
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30796
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30797
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30798
2018-10-22 08:16:31 [DEBUG   ] 2018-10-22 08:16:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30799
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30774 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30775 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30776 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30777 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30778 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30779 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30780 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30781 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30782 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30783 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30784 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30785 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30786 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30787 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30788 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30789 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30790 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30791 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30792 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30793 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30794 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30795 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30796 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30797 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30798 exited with status 0
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30799 exited with status 0
2018-10-22 08:16:43 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] spawn_process: at 2018-10-22 08:16:43 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30826
2018-10-22 08:16:43 [DEBUG   ] 2018-10-22 08:16:43 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30827
2018-10-22 08:16:49 [DEBUG   ] 2018-10-22 08:16:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30826 exited with status 0
2018-10-22 08:16:49 [DEBUG   ] 2018-10-22 08:16:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30827 exited with status 0
2018-10-22 08:16:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-10-22 08:16:49 [DEBUG   ] spawn_process: at 2018-10-22 08:16:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-10-22 08:16:49 [DEBUG   ] spawn_process: at 2018-10-22 08:16:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-10-22 08:16:49 [INFO    ] Setting Beam 1 xbars
2018-10-22 08:16:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-10-22 08:16:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-10-22 08:16:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-10-22 08:16:49 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-10-22 08:16:49 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-10-22 08:16:49 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-10-22 08:16:49 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-10-22 08:16:49 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-10-22 08:16:49 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-10-22 08:16:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-10-22 08:16:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-10-22 08:16:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-10-22 08:16:50 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-10-22 08:16:50 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-10-22 08:16:50 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-10-22 08:16:50 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-10-22 08:16:50 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-10-22 08:16:50 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-10-22 08:16:50 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-10-22 08:16:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-10-22 08:16:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-10-22 08:16:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-10-22 08:16:51 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-10-22 08:16:51 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-10-22 08:16:51 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-10-22 08:16:51 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-10-22 08:16:51 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-10-22 08:16:51 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-10-22 08:16:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-10-22 08:16:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-10-22 08:16:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-10-22 08:16:52 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-10-22 08:16:52 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-10-22 08:16:52 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-10-22 08:16:52 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-10-22 08:16:52 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-10-22 08:16:52 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-10-22 08:16:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-10-22 08:16:53 [DEBUG   ] Got command RPT from MCS: ref #232686
2018-10-22 08:16:53 [DEBUG   ] summary = BOOTING
2018-10-22 08:16:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232686  15 58413 29813078 ABOOTINGBOOTING'
2018-10-22 08:16:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-10-22 08:16:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-10-22 08:16:53 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-10-22 08:16:53 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-10-22 08:16:53 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-10-22 08:16:53 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-10-22 08:16:53 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-10-22 08:16:53 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-10-22 08:16:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-10-22 08:16:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-10-22 08:16:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-10-22 08:16:54 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-10-22 08:16:54 [INFO    ] Setting Beam 2 xbars
2018-10-22 08:16:54 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-10-22 08:16:54 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-10-22 08:16:54 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-10-22 08:16:54 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-10-22 08:16:54 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-10-22 08:16:54 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-10-22 08:16:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-10-22 08:16:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-10-22 08:16:55 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-10-22 08:16:55 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-10-22 08:16:55 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-10-22 08:16:55 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-10-22 08:16:55 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-10-22 08:16:55 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-10-22 08:16:55 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-10-22 08:16:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-10-22 08:16:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-10-22 08:16:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-10-22 08:16:56 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-10-22 08:16:56 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-10-22 08:16:56 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-10-22 08:16:56 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-10-22 08:16:56 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-10-22 08:16:56 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-10-22 08:16:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-10-22 08:16:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-10-22 08:16:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-10-22 08:16:57 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-10-22 08:16:57 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-10-22 08:16:57 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-10-22 08:16:57 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-10-22 08:16:57 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-10-22 08:16:57 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-10-22 08:16:57 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-10-22 08:16:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-10-22 08:16:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-10-22 08:16:58 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-10-22 08:16:58 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-10-22 08:16:58 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-10-22 08:16:58 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-10-22 08:16:58 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-10-22 08:16:58 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-10-22 08:16:58 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-10-22 08:16:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-10-22 08:16:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-10-22 08:16:59 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-10-22 08:16:59 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-10-22 08:16:59 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-10-22 08:16:59 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-10-22 08:16:59 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-10-22 08:16:59 [INFO    ] Setting Beam 3 xbars
2018-10-22 08:16:59 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-10-22 08:16:59 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-10-22 08:17:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-10-22 08:17:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-10-22 08:17:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-10-22 08:17:00 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-10-22 08:17:00 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-10-22 08:17:00 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-10-22 08:17:00 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-10-22 08:17:00 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-10-22 08:17:00 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-10-22 08:17:00 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-10-22 08:17:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-10-22 08:17:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-10-22 08:17:01 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-10-22 08:17:01 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-10-22 08:17:01 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-10-22 08:17:01 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-10-22 08:17:01 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-10-22 08:17:01 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-10-22 08:17:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-10-22 08:17:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-10-22 08:17:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-10-22 08:17:02 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-10-22 08:17:02 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-10-22 08:17:02 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-10-22 08:17:02 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-10-22 08:17:02 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-10-22 08:17:02 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-10-22 08:17:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-10-22 08:17:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-10-22 08:17:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-10-22 08:17:03 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-10-22 08:17:03 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-10-22 08:17:03 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-10-22 08:17:03 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-10-22 08:17:03 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-10-22 08:17:03 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-10-22 08:17:03 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-10-22 08:17:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-10-22 08:17:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-10-22 08:17:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-10-22 08:17:04 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-10-22 08:17:04 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-10-22 08:17:04 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-10-22 08:17:04 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-10-22 08:17:04 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-10-22 08:17:04 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-10-22 08:17:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-10-22 08:17:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-10-22 08:17:05 [INFO    ] Setting Beam 4 xbars
2018-10-22 08:17:05 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-10-22 08:17:05 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-22 08:17:05 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-22 08:17:05 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-10-22 08:17:05 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-10-22 08:17:05 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-10-22 08:17:05 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-10-22 08:17:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-10-22 08:17:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-10-22 08:17:06 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-10-22 08:17:06 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-10-22 08:17:06 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-10-22 08:17:06 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-10-22 08:17:06 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-10-22 08:17:06 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-10-22 08:17:06 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-10-22 08:17:06 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-10-22 08:17:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-10-22 08:17:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-10-22 08:17:07 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-10-22 08:17:07 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-10-22 08:17:07 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-10-22 08:17:07 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-10-22 08:17:07 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-10-22 08:17:07 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-10-22 08:17:07 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-10-22 08:17:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-10-22 08:17:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-10-22 08:17:08 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-10-22 08:17:08 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-10-22 08:17:08 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-10-22 08:17:08 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-10-22 08:17:08 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-10-22 08:17:08 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-10-22 08:17:08 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-10-22 08:17:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-10-22 08:17:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-10-22 08:17:09 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-10-22 08:17:09 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-10-22 08:17:09 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-10-22 08:17:09 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-10-22 08:17:09 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-10-22 08:17:09 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-10-22 08:17:09 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-10-22 08:17:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-10-22 08:17:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-10-22 08:17:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-10-22 08:17:10 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-10-22 08:17:10 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-10-22 08:17:10 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-10-22 08:17:10 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-10-22 08:17:10 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-10-22 08:17:10 [INFO    ] All xbars set
2018-10-22 08:17:10 [INFO    ] Setting adder chain routing for all beams
2018-10-22 08:17:15 [INFO    ] Setting beam ids
2018-10-22 08:17:25 [INFO    ] Starting beam delay calibration
2018-10-22 08:17:37 [INFO    ] Beam 1 latency is 5720
2018-10-22 08:17:37 [INFO    ] Beam 2 latency is 5760
2018-10-22 08:17:37 [INFO    ] Beam 3 latency is 5758
2018-10-22 08:17:37 [INFO    ] Beam 4 latency is 5725
2018-10-22 08:17:37 [INFO    ] Stop calibration
2018-10-22 08:17:45 [INFO    ] Beam delay calibration successful
2018-10-22 08:17:45 [INFO    ] Calibration passed
2018-10-22 08:17:45 [DEBUG   ] spawn_process: at 2018-10-22 08:17:45 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-10-22 08:17:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-10-22 08:17:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-10-22 08:17:45 [DEBUG   ] spawn_process: at 2018-10-22 08:17:45 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-10-22 08:17:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-10-22 08:17:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-10-22 08:17:45 [DEBUG   ] spawn_process: at 2018-10-22 08:17:45 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-10-22 08:17:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-10-22 08:17:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-10-22 08:17:45 [DEBUG   ] spawn_process: at 2018-10-22 08:17:45 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-10-22 08:17:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-10-22 08:17:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-10-22 08:17:45 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-10-22 08:17:46 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 270 ms (1540196266.272 s) with PID 32398 and time 1540196267
2018-10-22 08:17:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-10-22 08:17:46 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 359 ms (1540196266.361 s) with PID 32401 and time 1540196267
2018-10-22 08:17:47 [DEBUG   ] Finished updating ant stats in 0.886 seconds
2018-10-22 08:17:47 [INFO    ] Started antennas statistics background thread
2018-10-22 08:17:47 [INFO    ] Started board flags background thread
2018-10-22 08:17:47 [INFO    ] Started BAM background thread
2018-10-22 08:17:47 [INFO    ] Finished the INI process (ref. #232685) in 102.323 s
2018-10-22 08:17:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:17:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:17:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:17:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:17:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:17:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:17:48 [DEBUG   ] Finished updating board flags in 1.101 seconds
2018-10-22 08:18:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 08:18:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 08:18:28 [DEBUG   ] Got command RPT from MCS: ref #232696
2018-10-22 08:18:28 [DEBUG   ] summary = ERROR
2018-10-22 08:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232696  13 58413 29908849 A  ERRORERROR'
2018-10-22 08:18:28 [DEBUG   ] Got command RPT from MCS: ref #232697
2018-10-22 08:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232697  77 58413 29908850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:18:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 08:18:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:18:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:18:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:18:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:18:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:18:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:18:48 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-10-22 08:19:05 [DEBUG   ] Got command RPT from MCS: ref #232717
2018-10-22 08:19:05 [DEBUG   ] summary = ERROR
2018-10-22 08:19:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232717  13 58413 29945169 A  ERRORERROR'
2018-10-22 08:19:05 [DEBUG   ] Got command RPT from MCS: ref #232718
2018-10-22 08:19:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:19:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232718  77 58413 29945170 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:19:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 08:19:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 08:19:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 08:19:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:19:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:19:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:19:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:19:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:19:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:19:48 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-10-22 08:20:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 08:20:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 08:20:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:20:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:20:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2018-10-22 08:20:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:20:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:20:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:20:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:20:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:20:48 [DEBUG   ] Finished updating board flags in 1.227 seconds
2018-10-22 08:21:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:21:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:21:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:21:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:21:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:21:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:21:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:21:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:21:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:21:49 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-10-22 08:21:53 [DEBUG   ] Got command RPT from MCS: ref #232768
2018-10-22 08:21:53 [DEBUG   ] summary = ERROR
2018-10-22 08:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232768  13 58413 30113149 A  ERRORERROR'
2018-10-22 08:21:53 [DEBUG   ] Got command RPT from MCS: ref #232769
2018-10-22 08:21:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232769  77 58413 30113353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:21:53 [DEBUG   ] Got command RPT from MCS: ref #232770
2018-10-22 08:21:53 [DEBUG   ] summary = ERROR
2018-10-22 08:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232770  13 58413 30113557 A  ERRORERROR'
2018-10-22 08:21:53 [DEBUG   ] Got command RPT from MCS: ref #232771
2018-10-22 08:21:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232771  77 58413 30113749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:21:53 [DEBUG   ] Got command RPT from MCS: ref #232773
2018-10-22 08:21:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 08:21:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232773  12 58413 30113953 A  ERRORB‘™š'
2018-10-22 08:22:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:22:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:22:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:22:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:22:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 08:22:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 08:22:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:22:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:22:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:22:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:22:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:22:49 [DEBUG   ] Finished updating board flags in 1.719 seconds
2018-10-22 08:23:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:23:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:23:28 [DEBUG   ] Got command RPT from MCS: ref #232778
2018-10-22 08:23:28 [DEBUG   ] summary = ERROR
2018-10-22 08:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232778  13 58413 30208849 A  ERRORERROR'
2018-10-22 08:23:28 [DEBUG   ] Got command RPT from MCS: ref #232779
2018-10-22 08:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232779  77 58413 30208850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:23:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:23:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:23:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:23:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:23:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:23:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:23:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:23:48 [DEBUG   ] Finished updating board flags in 1.053 seconds
2018-10-22 08:24:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:24:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 08:24:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:24:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:24:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-10-22 08:24:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:24:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:24:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:24:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:24:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:24:48 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-10-22 08:25:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 08:25:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:25:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:25:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:25:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-10-22 08:25:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:25:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:25:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:25:48 [WARNING ] (13, 1, 'bot')
2018-10-22 08:25:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:25:48 [DEBUG   ] Finished updating board flags in 0.980 seconds
2018-10-22 08:26:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:26:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 08:26:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 08:26:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:26:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:26:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:26:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:26:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:26:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:26:49 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-22 08:26:53 [DEBUG   ] Got command RPT from MCS: ref #232799
2018-10-22 08:26:53 [DEBUG   ] summary = ERROR
2018-10-22 08:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232799  13 58413 30413237 A  ERRORERROR'
2018-10-22 08:26:53 [DEBUG   ] Got command RPT from MCS: ref #232800
2018-10-22 08:26:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232800  77 58413 30413429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:26:53 [DEBUG   ] Got command RPT from MCS: ref #232801
2018-10-22 08:26:53 [DEBUG   ] summary = ERROR
2018-10-22 08:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232801  13 58413 30413633 A  ERRORERROR'
2018-10-22 08:26:53 [DEBUG   ] Got command RPT from MCS: ref #232802
2018-10-22 08:26:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:26:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232802  77 58413 30413837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:26:54 [DEBUG   ] Got command RPT from MCS: ref #232803
2018-10-22 08:26:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 08:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232803  12 58413 30414029 A  ERRORB˜™š'
2018-10-22 08:27:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 08:27:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 08:27:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 08:27:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:27:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 08:27:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 08:27:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:27:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:27:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:27:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:27:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:27:49 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-10-22 08:28:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 08:28:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 08:28:28 [DEBUG   ] Got command RPT from MCS: ref #232808
2018-10-22 08:28:28 [DEBUG   ] summary = ERROR
2018-10-22 08:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232808  13 58413 30508849 A  ERRORERROR'
2018-10-22 08:28:28 [DEBUG   ] Got command RPT from MCS: ref #232809
2018-10-22 08:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232809  77 58413 30508850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:28:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 08:28:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:28:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:28:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:28:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:28:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:28:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:28:49 [DEBUG   ] Finished updating board flags in 1.309 seconds
2018-10-22 08:29:07 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-10-22 08:29:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:29:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:29:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:29:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 08:29:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:29:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:29:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:29:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:29:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:29:49 [DEBUG   ] Finished updating board flags in 1.212 seconds
2018-10-22 08:30:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:30:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:30:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:30:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:30:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:30:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:30:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:30:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:30:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:30:49 [DEBUG   ] Finished updating board flags in 1.179 seconds
2018-10-22 08:31:00 [DEBUG   ] Got command TBN from MCS: ref #232829
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-10-22 08:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   232829   8 58413 30660245 A  ERROR'
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540197061']
2018-10-22 08:31:00 [DEBUG   ] spawn_process: at 2018-10-22 08:31:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540197061']
2018-10-22 08:31:00 [INFO    ] Finished spawning TBN in 0.048 s
2018-10-22 08:31:08 [DEBUG   ] Finished updating ant stats in 1.267 seconds
2018-10-22 08:31:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:31:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:31:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:31:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 08:31:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:31:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:31:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:31:49 [WARNING ] (13, 1, 'bot')
2018-10-22 08:31:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:31:49 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-10-22 08:31:53 [DEBUG   ] Got command RPT from MCS: ref #232832
2018-10-22 08:31:53 [DEBUG   ] summary = ERROR
2018-10-22 08:31:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232832  13 58413 30713317 A  ERRORERROR'
2018-10-22 08:31:53 [DEBUG   ] Got command RPT from MCS: ref #232833
2018-10-22 08:31:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:31:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232833  77 58413 30713509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:31:53 [DEBUG   ] Got command RPT from MCS: ref #232834
2018-10-22 08:31:53 [DEBUG   ] summary = ERROR
2018-10-22 08:31:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232834  13 58413 30713713 A  ERRORERROR'
2018-10-22 08:31:53 [DEBUG   ] Got command RPT from MCS: ref #232835
2018-10-22 08:31:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:31:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232835  77 58413 30713917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:31:54 [DEBUG   ] Got command RPT from MCS: ref #232837
2018-10-22 08:31:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 08:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232837  12 58413 30714121 A  ERRORBš™š'
2018-10-22 08:32:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:32:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 08:32:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:32:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:32:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:32:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:32:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:32:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:32:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:32:50 [DEBUG   ] Finished updating board flags in 2.166 seconds
2018-10-22 08:33:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:33:11 [DEBUG   ] Got command TBW from MCS: ref #232847
2018-10-22 08:33:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-10-22 08:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   232847   8 58413 30791317 A  ERROR'
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-10-22 08:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-10-22 08:33:14 [DEBUG   ] spawn_process: at 2018-10-22 08:33:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-10-22 08:33:14 [INFO    ] Finished spawning TBW
2018-10-22 08:33:28 [DEBUG   ] Got command RPT from MCS: ref #232849
2018-10-22 08:33:28 [DEBUG   ] summary = ERROR
2018-10-22 08:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232849  13 58413 30808845 A  ERRORERROR'
2018-10-22 08:33:28 [DEBUG   ] Got command RPT from MCS: ref #232850
2018-10-22 08:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232850  77 58413 30808846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:33:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:33:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:33:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:33:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:33:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:33:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:33:50 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-10-22 08:34:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:34:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 08:34:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:34:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:34:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:34:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:34:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:34:50 [DEBUG   ] Finished updating board flags in 1.935 seconds
2018-10-22 08:35:02 [INFO    ] __waitForTBW - TBW finished in 108.092 s
2018-10-22 08:35:03 [INFO    ] Started antennas statistics background thread
2018-10-22 08:35:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1540197305']
2018-10-22 08:35:03 [DEBUG   ] spawn_process: at 2018-10-22 08:35:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1540197305']
2018-10-22 08:35:03 [INFO    ] Finished spawning TBN in 0.047 s
2018-10-22 08:35:04 [DEBUG   ] Finished updating ant stats in 1.299 seconds
2018-10-22 08:35:24 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2018-10-22 08:35:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 08:35:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:35:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:35:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:35:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:35:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:35:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:35:50 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-22 08:36:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:36:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:36:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:36:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:36:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:36:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:36:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:36:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:36:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:36:50 [DEBUG   ] Finished updating board flags in 1.653 seconds
2018-10-22 08:36:53 [DEBUG   ] Got command RPT from MCS: ref #232876
2018-10-22 08:36:53 [DEBUG   ] summary = ERROR
2018-10-22 08:36:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232876  13 58413 31013389 A  ERRORERROR'
2018-10-22 08:36:53 [DEBUG   ] Got command RPT from MCS: ref #232877
2018-10-22 08:36:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:36:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232877  77 58413 31013593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:36:53 [DEBUG   ] Got command RPT from MCS: ref #232878
2018-10-22 08:36:53 [DEBUG   ] summary = ERROR
2018-10-22 08:36:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232878  13 58413 31013797 A  ERRORERROR'
2018-10-22 08:36:54 [DEBUG   ] Got command RPT from MCS: ref #232879
2018-10-22 08:36:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232879  77 58413 31014001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:36:54 [DEBUG   ] Got command RPT from MCS: ref #232880
2018-10-22 08:36:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 08:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232880  12 58413 31014193 A  ERRORBš™š'
2018-10-22 08:37:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 08:37:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:37:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:37:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 08:37:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:37:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:37:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:37:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:37:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:37:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:37:50 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-10-22 08:38:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:38:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 08:38:28 [DEBUG   ] Got command RPT from MCS: ref #232881
2018-10-22 08:38:28 [DEBUG   ] summary = ERROR
2018-10-22 08:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232881  13 58413 31108853 A  ERRORERROR'
2018-10-22 08:38:28 [DEBUG   ] Got command RPT from MCS: ref #232882
2018-10-22 08:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232882  77 58413 31108854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:38:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:38:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:38:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:38:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:38:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:38:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:38:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:38:50 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-10-22 08:39:04 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-10-22 08:39:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 08:39:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 08:39:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:39:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:39:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:39:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:39:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:39:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:39:50 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-10-22 08:40:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 08:40:24 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-22 08:40:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 08:40:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:40:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:40:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:40:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:40:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:40:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:40:50 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-10-22 08:41:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 08:41:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 08:41:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 08:41:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:41:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:41:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:41:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:41:50 [WARNING ] (13, 1, 'bot')
2018-10-22 08:41:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:41:50 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-10-22 08:41:53 [DEBUG   ] Got command RPT from MCS: ref #232904
2018-10-22 08:41:53 [DEBUG   ] summary = ERROR
2018-10-22 08:41:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232904  13 58413 31313469 A  ERRORERROR'
2018-10-22 08:41:53 [DEBUG   ] Got command RPT from MCS: ref #232905
2018-10-22 08:41:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:41:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232905  77 58413 31313673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:41:53 [DEBUG   ] Got command RPT from MCS: ref #232906
2018-10-22 08:41:53 [DEBUG   ] summary = ERROR
2018-10-22 08:41:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232906  13 58413 31313877 A  ERRORERROR'
2018-10-22 08:41:54 [DEBUG   ] Got command RPT from MCS: ref #232908
2018-10-22 08:41:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232908  77 58413 31314081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:41:54 [DEBUG   ] Got command RPT from MCS: ref #232909
2018-10-22 08:41:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 08:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232909  12 58413 31314273 A  ERRORB™™š'
2018-10-22 08:42:04 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-10-22 08:42:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 08:42:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 08:42:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:42:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:42:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:42:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:42:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:42:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:42:51 [DEBUG   ] Finished updating board flags in 2.032 seconds
2018-10-22 08:43:04 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-22 08:43:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-22 08:43:28 [DEBUG   ] Got command RPT from MCS: ref #232918
2018-10-22 08:43:28 [DEBUG   ] summary = ERROR
2018-10-22 08:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232918  13 58413 31408849 A  ERRORERROR'
2018-10-22 08:43:28 [DEBUG   ] Got command RPT from MCS: ref #232919
2018-10-22 08:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232919  77 58413 31408850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:43:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 08:43:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 08:43:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:43:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:43:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:43:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:43:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:43:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:43:51 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-10-22 08:44:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:44:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:44:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:44:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:44:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:44:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:44:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:44:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:44:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:44:51 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-22 08:45:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 08:45:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:45:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:45:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 08:45:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:45:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:45:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:45:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:45:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:45:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:45:51 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-22 08:46:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 08:46:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 08:46:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:46:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:46:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:46:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:46:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:46:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:46:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:46:51 [DEBUG   ] Finished updating board flags in 1.884 seconds
2018-10-22 08:46:53 [DEBUG   ] Got command RPT from MCS: ref #232939
2018-10-22 08:46:53 [DEBUG   ] summary = ERROR
2018-10-22 08:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232939  13 58413 31613553 A  ERRORERROR'
2018-10-22 08:46:53 [DEBUG   ] Got command RPT from MCS: ref #232940
2018-10-22 08:46:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232940  77 58413 31613757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:46:53 [DEBUG   ] Got command RPT from MCS: ref #232941
2018-10-22 08:46:53 [DEBUG   ] summary = ERROR
2018-10-22 08:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232941  13 58413 31613949 A  ERRORERROR'
2018-10-22 08:46:54 [DEBUG   ] Got command RPT from MCS: ref #232942
2018-10-22 08:46:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232942  77 58413 31614153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:46:54 [DEBUG   ] Got command RPT from MCS: ref #232943
2018-10-22 08:46:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 08:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232943  12 58413 31614357 A  ERRORB™™š'
2018-10-22 08:47:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:47:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 08:47:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:47:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:47:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:47:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:47:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:47:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:47:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:47:51 [DEBUG   ] Finished updating board flags in 1.729 seconds
2018-10-22 08:48:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:48:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 08:48:28 [DEBUG   ] Got command RPT from MCS: ref #232948
2018-10-22 08:48:28 [DEBUG   ] summary = ERROR
2018-10-22 08:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232948  13 58413 31708845 A  ERRORERROR'
2018-10-22 08:48:28 [DEBUG   ] Got command RPT from MCS: ref #232949
2018-10-22 08:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232949  77 58413 31708846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:48:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 08:48:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:48:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:48:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:48:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:48:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:48:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:48:51 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-10-22 08:49:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:49:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:49:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:49:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:49:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 08:49:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:49:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:49:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:49:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:49:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:49:51 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-10-22 08:50:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 08:50:25 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-10-22 08:50:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 08:50:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:50:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 08:50:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:50:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:50:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:50:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:50:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:50:51 [DEBUG   ] Finished updating board flags in 1.483 seconds
2018-10-22 08:51:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 08:51:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 08:51:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 08:51:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 08:51:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:51:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 08:51:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:51:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:51:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:51:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:51:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:51:51 [DEBUG   ] Finished updating board flags in 1.499 seconds
2018-10-22 08:51:53 [DEBUG   ] Got command RPT from MCS: ref #232971
2018-10-22 08:51:53 [DEBUG   ] summary = ERROR
2018-10-22 08:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232971  13 58413 31913633 A  ERRORERROR'
2018-10-22 08:51:53 [DEBUG   ] Got command RPT from MCS: ref #232972
2018-10-22 08:51:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232972  77 58413 31913837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:51:54 [DEBUG   ] Got command RPT from MCS: ref #232973
2018-10-22 08:51:54 [DEBUG   ] summary = ERROR
2018-10-22 08:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232973  13 58413 31914041 A  ERRORERROR'
2018-10-22 08:51:54 [DEBUG   ] Got command RPT from MCS: ref #232975
2018-10-22 08:51:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232975  77 58413 31914233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:51:54 [DEBUG   ] Got command RPT from MCS: ref #232976
2018-10-22 08:51:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 08:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232976  12 58413 31914437 A  ERRORB™™š'
2018-10-22 08:52:05 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-22 08:52:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 08:52:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 08:52:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:52:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:52:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:52:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:52:51 [WARNING ] (13, 1, 'bot')
2018-10-22 08:52:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:52:51 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-10-22 08:53:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 08:53:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 08:53:28 [DEBUG   ] Got command RPT from MCS: ref #232981
2018-10-22 08:53:28 [DEBUG   ] summary = ERROR
2018-10-22 08:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232981  13 58413 32008853 A  ERRORERROR'
2018-10-22 08:53:28 [DEBUG   ] Got command RPT from MCS: ref #232982
2018-10-22 08:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   232982  77 58413 32008854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:53:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 08:53:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:53:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:53:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:53:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:53:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:53:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:53:52 [DEBUG   ] Finished updating board flags in 2.152 seconds
2018-10-22 08:54:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 08:54:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 08:54:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 08:54:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:54:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 08:54:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:54:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:54:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:54:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:54:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:54:52 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-10-22 08:55:05 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-10-22 08:55:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 08:55:46 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-22 08:55:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:55:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:55:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:55:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:55:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:55:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:55:52 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-22 08:56:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 08:56:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 08:56:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 08:56:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:56:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:56:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:56:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:56:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:56:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:56:52 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-10-22 08:56:53 [DEBUG   ] Got command RPT from MCS: ref #233002
2018-10-22 08:56:53 [DEBUG   ] summary = ERROR
2018-10-22 08:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233002  13 58413 32213721 A  ERRORERROR'
2018-10-22 08:56:53 [DEBUG   ] Got command RPT from MCS: ref #233003
2018-10-22 08:56:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:56:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233003  77 58413 32213913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:56:54 [DEBUG   ] Got command RPT from MCS: ref #233004
2018-10-22 08:56:54 [DEBUG   ] summary = ERROR
2018-10-22 08:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233004  13 58413 32214117 A  ERRORERROR'
2018-10-22 08:56:54 [DEBUG   ] Got command RPT from MCS: ref #233005
2018-10-22 08:56:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233005  77 58413 32214321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:56:54 [DEBUG   ] Got command RPT from MCS: ref #233006
2018-10-22 08:56:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 08:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233006  12 58413 32214513 A  ERRORB˜™š'
2018-10-22 08:57:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 08:57:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 08:57:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 08:57:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:57:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:57:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:57:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:57:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:57:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:57:52 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-10-22 08:58:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 08:58:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 08:58:28 [DEBUG   ] Got command RPT from MCS: ref #233011
2018-10-22 08:58:28 [DEBUG   ] summary = ERROR
2018-10-22 08:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233011  13 58413 32308849 A  ERRORERROR'
2018-10-22 08:58:28 [DEBUG   ] Got command RPT from MCS: ref #233012
2018-10-22 08:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 08:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233012  77 58413 32308850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 08:58:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 08:58:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:58:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:58:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:58:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:58:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:58:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:58:52 [DEBUG   ] Finished updating board flags in 1.669 seconds
2018-10-22 08:59:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 08:59:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 08:59:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 08:59:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 08:59:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:59:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:59:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:59:52 [WARNING ] (13, 1, 'bot')
2018-10-22 08:59:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 08:59:52 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-10-22 09:00:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:00:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:00:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:00:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:00:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:00:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:00:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:00:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:00:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:00:52 [DEBUG   ] Finished updating board flags in 1.516 seconds
2018-10-22 09:01:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:01:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:01:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:01:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:01:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:01:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:01:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:01:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:01:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:01:52 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-10-22 09:01:53 [DEBUG   ] Got command RPT from MCS: ref #233034
2018-10-22 09:01:53 [DEBUG   ] summary = ERROR
2018-10-22 09:01:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233034  13 58413 32513789 A  ERRORERROR'
2018-10-22 09:01:53 [DEBUG   ] Got command RPT from MCS: ref #233035
2018-10-22 09:01:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:01:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233035  77 58413 32513993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:01:54 [DEBUG   ] Got command RPT from MCS: ref #233036
2018-10-22 09:01:54 [DEBUG   ] summary = ERROR
2018-10-22 09:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233036  13 58413 32514197 A  ERRORERROR'
2018-10-22 09:01:54 [DEBUG   ] Got command RPT from MCS: ref #233038
2018-10-22 09:01:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233038  77 58413 32514401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:01:54 [DEBUG   ] Got command RPT from MCS: ref #233040
2018-10-22 09:01:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233040  12 58413 32514593 A  ERRORB˜™š'
2018-10-22 09:02:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 09:02:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 09:02:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:02:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:02:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:02:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:02:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:02:52 [WARNING ] (13, 1, 'bot')
2018-10-22 09:02:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:02:52 [DEBUG   ] Finished updating board flags in 1.514 seconds
2018-10-22 09:03:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:03:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 09:03:28 [DEBUG   ] Got command RPT from MCS: ref #233048
2018-10-22 09:03:28 [DEBUG   ] summary = ERROR
2018-10-22 09:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233048  13 58413 32608853 A  ERRORERROR'
2018-10-22 09:03:28 [DEBUG   ] Got command RPT from MCS: ref #233049
2018-10-22 09:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233049  77 58413 32608854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:03:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 09:03:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 09:03:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:03:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:03:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:03:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:03:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:03:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:03:53 [DEBUG   ] Finished updating board flags in 2.205 seconds
2018-10-22 09:04:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 09:04:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 09:04:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 09:04:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 09:04:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:04:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-22 09:04:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:04:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:04:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:04:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:04:53 [WARNING ] (25, 5, 'bot')
2018-10-22 09:04:53 [WARNING ] (25, 5, 'bot')
2018-10-22 09:04:53 [WARNING ] (25, 5, 'bot')
2018-10-22 09:04:53 [WARNING ] (25, 5, 'bot')
2018-10-22 09:04:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:04:53 [DEBUG   ] Finished updating board flags in 2.292 seconds
2018-10-22 09:05:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 09:05:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 09:05:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 09:05:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 09:05:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:05:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:05:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:05:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:05:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:05:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:05:53 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-10-22 09:06:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 09:06:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 09:06:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 09:06:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 09:06:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:06:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:06:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:06:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:06:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:06:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:06:53 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-10-22 09:06:53 [DEBUG   ] Got command RPT from MCS: ref #233069
2018-10-22 09:06:53 [DEBUG   ] summary = ERROR
2018-10-22 09:06:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233069  13 58413 32813881 A  ERRORERROR'
2018-10-22 09:06:54 [DEBUG   ] Got command RPT from MCS: ref #233070
2018-10-22 09:06:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:06:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233070  77 58413 32814073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:06:54 [DEBUG   ] Got command RPT from MCS: ref #233071
2018-10-22 09:06:54 [DEBUG   ] summary = ERROR
2018-10-22 09:06:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233071  13 58413 32814277 A  ERRORERROR'
2018-10-22 09:06:54 [DEBUG   ] Got command RPT from MCS: ref #233072
2018-10-22 09:06:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:06:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233072  77 58413 32814481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:06:54 [DEBUG   ] Got command RPT from MCS: ref #233073
2018-10-22 09:06:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:06:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233073  12 58413 32814673 A  ERRORB—™š'
2018-10-22 09:07:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 09:07:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 09:07:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 09:07:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:07:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:07:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:07:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:07:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:07:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:07:53 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-10-22 09:08:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 09:08:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 09:08:28 [DEBUG   ] Got command RPT from MCS: ref #233074
2018-10-22 09:08:28 [DEBUG   ] summary = ERROR
2018-10-22 09:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233074  13 58413 32908849 A  ERRORERROR'
2018-10-22 09:08:28 [DEBUG   ] Got command RPT from MCS: ref #233075
2018-10-22 09:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233075  77 58413 32908850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:08:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 09:08:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:08:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:08:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:08:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:08:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:08:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:08:53 [DEBUG   ] Finished updating board flags in 1.831 seconds
2018-10-22 09:09:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 09:09:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 09:09:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 09:09:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:09:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:09:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:09:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:09:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:09:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:09:53 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-10-22 09:10:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 09:10:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 09:10:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 09:10:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:10:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 09:10:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-10-22 09:10:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:10:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:10:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:10:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:10:53 [WARNING ] (25, 5, 'bot')
2018-10-22 09:10:53 [WARNING ] (25, 5, 'bot')
2018-10-22 09:10:53 [WARNING ] (25, 5, 'bot')
2018-10-22 09:10:53 [WARNING ] (25, 5, 'bot')
2018-10-22 09:10:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:10:53 [DEBUG   ] Finished updating board flags in 1.717 seconds
2018-10-22 09:11:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 09:11:26 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-10-22 09:11:46 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-10-22 09:11:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:11:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:11:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:11:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:11:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:11:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:11:53 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-10-22 09:11:53 [DEBUG   ] Got command RPT from MCS: ref #233097
2018-10-22 09:11:53 [DEBUG   ] summary = ERROR
2018-10-22 09:11:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233097  13 58413 33113949 A  ERRORERROR'
2018-10-22 09:11:54 [DEBUG   ] Got command RPT from MCS: ref #233098
2018-10-22 09:11:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:11:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233098  77 58413 33114153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:11:54 [DEBUG   ] Got command RPT from MCS: ref #233099
2018-10-22 09:11:54 [DEBUG   ] summary = ERROR
2018-10-22 09:11:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233099  13 58413 33114357 A  ERRORERROR'
2018-10-22 09:11:54 [DEBUG   ] Got command RPT from MCS: ref #233101
2018-10-22 09:11:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:11:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233101  77 58413 33114561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:11:54 [DEBUG   ] Got command RPT from MCS: ref #233102
2018-10-22 09:11:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:11:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233102  12 58413 33114753 A  ERRORB—™š'
2018-10-22 09:12:07 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-22 09:12:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 09:12:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 09:12:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 09:12:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:12:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:12:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:12:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:12:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:12:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:12:53 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-10-22 09:13:07 [DEBUG   ] Finished updating ant stats in 1.186 seconds
2018-10-22 09:13:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:13:28 [DEBUG   ] Got command RPT from MCS: ref #233111
2018-10-22 09:13:28 [DEBUG   ] summary = ERROR
2018-10-22 09:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233111  13 58413 33208857 A  ERRORERROR'
2018-10-22 09:13:28 [DEBUG   ] Got command RPT from MCS: ref #233112
2018-10-22 09:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233112  77 58413 33208858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:13:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:13:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 09:13:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-22 09:13:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:13:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:13:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:13:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:13:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:13:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:13:53 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-10-22 09:14:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:14:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:14:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:14:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:14:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:14:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:14:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:14:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:14:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:14:53 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-10-22 09:15:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:15:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 09:15:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:15:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:15:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:15:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:15:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:15:53 [WARNING ] (13, 1, 'bot')
2018-10-22 09:15:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:15:53 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-10-22 09:16:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:16:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:16:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:16:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:16:54 [DEBUG   ] Got command RPT from MCS: ref #233132
2018-10-22 09:16:54 [DEBUG   ] summary = ERROR
2018-10-22 09:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233132  13 58413 33414029 A  ERRORERROR'
2018-10-22 09:16:54 [DEBUG   ] Got command RPT from MCS: ref #233133
2018-10-22 09:16:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233133  77 58413 33414237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:16:54 [DEBUG   ] Got command RPT from MCS: ref #233134
2018-10-22 09:16:54 [DEBUG   ] summary = ERROR
2018-10-22 09:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233134  13 58413 33414441 A  ERRORERROR'
2018-10-22 09:16:54 [DEBUG   ] Got command RPT from MCS: ref #233135
2018-10-22 09:16:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233135  77 58413 33414641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:16:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:16:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:16:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:16:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:16:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:16:54 [DEBUG   ] Finished updating board flags in 2.243 seconds
2018-10-22 09:16:54 [DEBUG   ] Got command RPT from MCS: ref #233136
2018-10-22 09:16:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233136  12 58413 33414833 A  ERRORB™™š'
2018-10-22 09:17:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:17:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:17:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:17:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:17:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:17:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:17:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:17:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:17:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:17:54 [DEBUG   ] Finished updating board flags in 2.173 seconds
2018-10-22 09:18:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:18:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:18:28 [DEBUG   ] Got command RPT from MCS: ref #233141
2018-10-22 09:18:28 [DEBUG   ] summary = ERROR
2018-10-22 09:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233141  13 58413 33508857 A  ERRORERROR'
2018-10-22 09:18:28 [DEBUG   ] Got command RPT from MCS: ref #233142
2018-10-22 09:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233142  77 58413 33508858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:18:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:18:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:18:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:18:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:18:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:18:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:18:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:18:54 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-10-22 09:19:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:19:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:19:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:19:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:19:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:19:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:19:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:19:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:19:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:19:54 [DEBUG   ] Finished updating board flags in 1.939 seconds
2018-10-22 09:20:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:20:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:20:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:20:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:20:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:20:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:20:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:20:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:20:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:20:54 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-22 09:21:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:21:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:21:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:21:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:21:54 [DEBUG   ] Got command RPT from MCS: ref #233164
2018-10-22 09:21:54 [DEBUG   ] summary = ERROR
2018-10-22 09:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233164  13 58413 33714117 A  ERRORERROR'
2018-10-22 09:21:54 [DEBUG   ] Got command RPT from MCS: ref #233165
2018-10-22 09:21:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233165  77 58413 33714309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:21:54 [DEBUG   ] Got command RPT from MCS: ref #233166
2018-10-22 09:21:54 [DEBUG   ] summary = ERROR
2018-10-22 09:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233166  13 58413 33714513 A  ERRORERROR'
2018-10-22 09:21:54 [DEBUG   ] Got command RPT from MCS: ref #233167
2018-10-22 09:21:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233167  77 58413 33714709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:21:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:21:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:21:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:21:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:21:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:21:54 [DEBUG   ] Finished updating board flags in 1.842 seconds
2018-10-22 09:21:54 [DEBUG   ] Got command RPT from MCS: ref #233169
2018-10-22 09:21:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:21:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233169  12 58413 33714917 A  ERRORB™™š'
2018-10-22 09:22:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:22:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:22:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:22:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:22:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:22:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:22:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:22:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:22:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:22:54 [DEBUG   ] Finished updating board flags in 1.742 seconds
2018-10-22 09:23:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:23:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:23:28 [DEBUG   ] Got command RPT from MCS: ref #233174
2018-10-22 09:23:28 [DEBUG   ] summary = ERROR
2018-10-22 09:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233174  13 58413 33808857 A  ERRORERROR'
2018-10-22 09:23:28 [DEBUG   ] Got command RPT from MCS: ref #233175
2018-10-22 09:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233175  77 58413 33808858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:23:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:23:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:23:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:23:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:23:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:23:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:23:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:23:54 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-22 09:24:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:24:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:24:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:24:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:24:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:24:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:24:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:24:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:24:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:24:54 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-10-22 09:25:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:25:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:25:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:25:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 09:25:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:25:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:25:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:25:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:25:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:25:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:25:54 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-10-22 09:26:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:26:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 09:26:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:26:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 09:26:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:26:54 [DEBUG   ] Got command RPT from MCS: ref #233195
2018-10-22 09:26:54 [DEBUG   ] summary = ERROR
2018-10-22 09:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233195  13 58413 34014189 A  ERRORERROR'
2018-10-22 09:26:54 [DEBUG   ] Got command RPT from MCS: ref #233196
2018-10-22 09:26:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233196  77 58413 34014393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:26:54 [DEBUG   ] Got command RPT from MCS: ref #233197
2018-10-22 09:26:54 [DEBUG   ] summary = ERROR
2018-10-22 09:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233197  13 58413 34014597 A  ERRORERROR'
2018-10-22 09:26:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:26:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:26:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:26:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:26:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:26:54 [DEBUG   ] Finished updating board flags in 1.651 seconds
2018-10-22 09:26:54 [DEBUG   ] Got command RPT from MCS: ref #233198
2018-10-22 09:26:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233198  77 58413 34014793 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:26:54 [DEBUG   ] Got command RPT from MCS: ref #233199
2018-10-22 09:26:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:26:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233199  12 58413 34014997 A  ERRORB™™š'
2018-10-22 09:27:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:27:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:27:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:27:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 09:27:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:27:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:27:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:27:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:27:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:27:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:27:54 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-10-22 09:28:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:28:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:28:28 [DEBUG   ] Got command RPT from MCS: ref #233204
2018-10-22 09:28:28 [DEBUG   ] summary = ERROR
2018-10-22 09:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233204  13 58413 34108853 A  ERRORERROR'
2018-10-22 09:28:28 [DEBUG   ] Got command RPT from MCS: ref #233205
2018-10-22 09:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233205  77 58413 34108854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:28:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:28:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:28:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:28:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:28:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:28:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:28:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:28:54 [DEBUG   ] Finished updating board flags in 1.519 seconds
2018-10-22 09:29:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:29:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:29:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:29:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:29:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 09:29:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:29:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:29:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:29:54 [WARNING ] (13, 1, 'bot')
2018-10-22 09:29:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:29:54 [DEBUG   ] Finished updating board flags in 1.522 seconds
2018-10-22 09:30:07 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 09:30:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 09:30:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 09:30:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:30:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:30:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:30:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:30:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:30:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:30:55 [DEBUG   ] Finished updating board flags in 2.197 seconds
2018-10-22 09:31:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 09:31:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 09:31:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 09:31:54 [DEBUG   ] Got command RPT from MCS: ref #233227
2018-10-22 09:31:54 [DEBUG   ] summary = ERROR
2018-10-22 09:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233227  13 58413 34314277 A  ERRORERROR'
2018-10-22 09:31:54 [DEBUG   ] Got command RPT from MCS: ref #233228
2018-10-22 09:31:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233228  77 58413 34314470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:31:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:31:54 [DEBUG   ] Got command RPT from MCS: ref #233229
2018-10-22 09:31:54 [DEBUG   ] summary = ERROR
2018-10-22 09:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233229  13 58413 34314673 A  ERRORERROR'
2018-10-22 09:31:54 [DEBUG   ] Got command RPT from MCS: ref #233231
2018-10-22 09:31:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:31:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233231  77 58413 34314877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:31:55 [DEBUG   ] Got command RPT from MCS: ref #233232
2018-10-22 09:31:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233232  12 58413 34315081 A  ERRORB‘™š'
2018-10-22 09:31:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:31:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:31:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:31:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:31:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:31:55 [DEBUG   ] Finished updating board flags in 1.961 seconds
2018-10-22 09:32:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 09:32:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 09:32:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 09:32:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:32:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:32:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:32:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:32:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:32:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:32:55 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-10-22 09:33:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 09:33:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 09:33:28 [DEBUG   ] Got command RPT from MCS: ref #233241
2018-10-22 09:33:28 [DEBUG   ] summary = ERROR
2018-10-22 09:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233241  13 58413 34408865 A  ERRORERROR'
2018-10-22 09:33:28 [DEBUG   ] Got command RPT from MCS: ref #233242
2018-10-22 09:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233242  77 58413 34408866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:33:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 09:33:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 09:33:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:33:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:33:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:33:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:33:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:33:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:33:55 [DEBUG   ] Finished updating board flags in 1.855 seconds
2018-10-22 09:34:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 09:34:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 09:34:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 09:34:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:34:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:34:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:34:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:34:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:34:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:34:55 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-10-22 09:35:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 09:35:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 09:35:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 09:35:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:35:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:35:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:35:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:35:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:35:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:35:55 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-10-22 09:36:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 09:36:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 09:36:48 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2018-10-22 09:36:54 [DEBUG   ] Got command RPT from MCS: ref #233262
2018-10-22 09:36:54 [DEBUG   ] summary = ERROR
2018-10-22 09:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233262  13 58413 34614357 A  ERRORERROR'
2018-10-22 09:36:54 [DEBUG   ] Got command RPT from MCS: ref #233263
2018-10-22 09:36:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233263  77 58413 34614553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:36:54 [DEBUG   ] Got command RPT from MCS: ref #233264
2018-10-22 09:36:54 [DEBUG   ] summary = ERROR
2018-10-22 09:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233264  13 58413 34614749 A  ERRORERROR'
2018-10-22 09:36:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:36:54 [DEBUG   ] Got command RPT from MCS: ref #233265
2018-10-22 09:36:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233265  77 58413 34614957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:36:55 [DEBUG   ] Got command RPT from MCS: ref #233266
2018-10-22 09:36:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233266  12 58413 34615161 A  ERRORB‘™š'
2018-10-22 09:36:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:36:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:36:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:36:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:36:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:36:55 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-10-22 09:37:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 09:37:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 09:37:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 09:37:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:37:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:37:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:37:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:37:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:37:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:37:55 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-10-22 09:38:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 09:38:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:38:28 [DEBUG   ] Got command RPT from MCS: ref #233267
2018-10-22 09:38:28 [DEBUG   ] summary = ERROR
2018-10-22 09:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233267  13 58413 34708857 A  ERRORERROR'
2018-10-22 09:38:28 [DEBUG   ] Got command RPT from MCS: ref #233268
2018-10-22 09:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233268  77 58413 34708858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:38:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:38:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:38:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:38:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:38:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:38:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:38:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:38:55 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-10-22 09:39:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:39:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 09:39:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:39:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:39:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:39:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:39:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:39:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:39:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:39:55 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-10-22 09:40:08 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 09:40:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 09:40:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 09:40:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:40:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:40:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:40:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:40:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:40:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:40:55 [DEBUG   ] Finished updating board flags in 1.458 seconds
2018-10-22 09:41:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 09:41:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 09:41:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 09:41:54 [DEBUG   ] Got command RPT from MCS: ref #233290
2018-10-22 09:41:54 [DEBUG   ] summary = ERROR
2018-10-22 09:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233290  13 58413 34914438 A  ERRORERROR'
2018-10-22 09:41:54 [DEBUG   ] Got command RPT from MCS: ref #233291
2018-10-22 09:41:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233291  77 58413 34914630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:41:54 [DEBUG   ] Got command RPT from MCS: ref #233292
2018-10-22 09:41:54 [DEBUG   ] summary = ERROR
2018-10-22 09:41:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233292  13 58413 34914837 A  ERRORERROR'
2018-10-22 09:41:55 [DEBUG   ] Got command RPT from MCS: ref #233294
2018-10-22 09:41:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:41:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233294  77 58413 34915029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:41:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:41:55 [DEBUG   ] Got command RPT from MCS: ref #233296
2018-10-22 09:41:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:41:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233296  12 58413 34915237 A  ERRORB�ÌÍ'
2018-10-22 09:41:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 09:41:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:41:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:41:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:41:55 [WARNING ] (13, 1, 'bot')
2018-10-22 09:41:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:41:55 [DEBUG   ] Finished updating board flags in 1.488 seconds
2018-10-22 09:42:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 09:42:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 09:42:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 09:42:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-10-22 09:42:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:42:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:42:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:42:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:42:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:42:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:42:56 [DEBUG   ] Finished updating board flags in 2.238 seconds
2018-10-22 09:43:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 09:43:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 09:43:28 [DEBUG   ] Got command RPT from MCS: ref #233304
2018-10-22 09:43:28 [DEBUG   ] summary = ERROR
2018-10-22 09:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233304  13 58413 35008865 A  ERRORERROR'
2018-10-22 09:43:28 [DEBUG   ] Got command RPT from MCS: ref #233305
2018-10-22 09:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233305  77 58413 35008866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:43:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 09:43:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:43:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:43:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:43:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:43:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:43:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:43:56 [DEBUG   ] Finished updating board flags in 2.126 seconds
2018-10-22 09:44:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 09:44:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 09:44:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 09:44:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:44:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 09:44:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:44:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:44:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:44:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:44:56 [DEBUG   ] Finished updating board flags in 2.039 seconds
2018-10-22 09:45:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 09:45:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 09:45:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 09:45:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 09:45:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:45:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:45:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:45:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:45:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:45:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:45:56 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-10-22 09:46:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 09:46:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 09:46:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 09:46:54 [DEBUG   ] Got command RPT from MCS: ref #233325
2018-10-22 09:46:54 [DEBUG   ] summary = ERROR
2018-10-22 09:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233325  13 58413 35214509 A  ERRORERROR'
2018-10-22 09:46:54 [DEBUG   ] Got command RPT from MCS: ref #233326
2018-10-22 09:46:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233326  77 58413 35214713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:46:54 [DEBUG   ] Got command RPT from MCS: ref #233327
2018-10-22 09:46:54 [DEBUG   ] summary = ERROR
2018-10-22 09:46:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233327  13 58413 35214917 A  ERRORERROR'
2018-10-22 09:46:55 [DEBUG   ] Got command RPT from MCS: ref #233328
2018-10-22 09:46:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233328  77 58413 35215122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:46:55 [DEBUG   ] Got command RPT from MCS: ref #233329
2018-10-22 09:46:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233329  12 58413 35215317 A  ERRORB†ÌÍ'
2018-10-22 09:46:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:46:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:46:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:46:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:46:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:46:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:46:56 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-10-22 09:47:08 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-10-22 09:47:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 09:47:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 09:47:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:47:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:47:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:47:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:47:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:47:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:47:56 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-10-22 09:48:08 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2018-10-22 09:48:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 09:48:28 [DEBUG   ] Got command RPT from MCS: ref #233334
2018-10-22 09:48:28 [DEBUG   ] summary = ERROR
2018-10-22 09:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233334  13 58413 35308865 A  ERRORERROR'
2018-10-22 09:48:28 [DEBUG   ] Got command RPT from MCS: ref #233335
2018-10-22 09:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233335  77 58413 35308866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:48:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-10-22 09:48:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:48:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:48:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:48:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:48:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:48:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:48:56 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-10-22 09:49:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 09:49:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 09:49:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 09:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:49:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:49:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:49:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:49:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:49:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:49:56 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-22 09:50:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 09:50:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 09:50:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 09:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 09:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:50:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:50:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:50:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:50:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:50:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:50:56 [DEBUG   ] Finished updating board flags in 1.532 seconds
2018-10-22 09:51:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 09:51:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 09:51:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 09:51:54 [DEBUG   ] Got command RPT from MCS: ref #233357
2018-10-22 09:51:54 [DEBUG   ] summary = ERROR
2018-10-22 09:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233357  13 58413 35514593 A  ERRORERROR'
2018-10-22 09:51:54 [DEBUG   ] Got command RPT from MCS: ref #233358
2018-10-22 09:51:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233358  77 58413 35514797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:51:54 [DEBUG   ] Got command RPT from MCS: ref #233359
2018-10-22 09:51:54 [DEBUG   ] summary = ERROR
2018-10-22 09:51:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233359  13 58413 35514989 A  ERRORERROR'
2018-10-22 09:51:55 [DEBUG   ] Got command RPT from MCS: ref #233361
2018-10-22 09:51:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233361  77 58413 35515193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:51:55 [DEBUG   ] Got command RPT from MCS: ref #233362
2018-10-22 09:51:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233362  12 58413 35515397 A  ERRORB™™š'
2018-10-22 09:51:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:51:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 09:51:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:51:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:51:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:51:56 [WARNING ] (13, 1, 'bot')
2018-10-22 09:51:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:51:56 [DEBUG   ] Finished updating board flags in 1.554 seconds
2018-10-22 09:52:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 09:52:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 09:52:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 09:52:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:52:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 09:52:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:52:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:52:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:52:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:52:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:52:57 [DEBUG   ] Finished updating board flags in 2.249 seconds
2018-10-22 09:53:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 09:53:28 [DEBUG   ] Got command RPT from MCS: ref #233367
2018-10-22 09:53:28 [DEBUG   ] summary = ERROR
2018-10-22 09:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233367  13 58413 35608869 A  ERRORERROR'
2018-10-22 09:53:28 [DEBUG   ] Got command RPT from MCS: ref #233368
2018-10-22 09:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233368  77 58413 35608870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:53:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 09:53:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 09:53:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:53:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 09:53:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 09:53:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:53:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:53:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:53:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:53:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:53:57 [DEBUG   ] Finished updating board flags in 2.100 seconds
2018-10-22 09:54:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 09:54:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 09:54:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 09:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:54:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:54:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:54:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:54:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:54:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:54:57 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-10-22 09:55:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 09:55:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 09:55:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 09:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:55:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 09:55:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 09:55:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:55:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:55:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:55:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:55:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:55:57 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-10-22 09:56:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 09:56:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:56:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 09:56:54 [DEBUG   ] Got command RPT from MCS: ref #233388
2018-10-22 09:56:54 [DEBUG   ] summary = ERROR
2018-10-22 09:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233388  13 58413 35814681 A  ERRORERROR'
2018-10-22 09:56:54 [DEBUG   ] Got command RPT from MCS: ref #233389
2018-10-22 09:56:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:56:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233389  77 58413 35814873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:56:55 [DEBUG   ] Got command RPT from MCS: ref #233390
2018-10-22 09:56:55 [DEBUG   ] summary = ERROR
2018-10-22 09:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233390  13 58413 35815077 A  ERRORERROR'
2018-10-22 09:56:55 [DEBUG   ] Got command RPT from MCS: ref #233391
2018-10-22 09:56:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233391  77 58413 35815281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:56:55 [DEBUG   ] Got command RPT from MCS: ref #233392
2018-10-22 09:56:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 09:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233392  12 58413 35815473 A  ERRORB˜™š'
2018-10-22 09:56:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:56:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:56:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:56:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:56:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:56:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:56:57 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-10-22 09:57:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:57:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:57:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 09:57:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:57:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:57:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:57:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:57:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:57:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:57:57 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-10-22 09:58:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:58:28 [DEBUG   ] Got command RPT from MCS: ref #233397
2018-10-22 09:58:28 [DEBUG   ] summary = ERROR
2018-10-22 09:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233397  13 58413 35908869 A  ERRORERROR'
2018-10-22 09:58:28 [DEBUG   ] Got command RPT from MCS: ref #233398
2018-10-22 09:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 09:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233398  77 58413 35908870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 09:58:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 09:58:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 09:58:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:58:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:58:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:58:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:58:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:58:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:58:57 [DEBUG   ] Finished updating board flags in 1.657 seconds
2018-10-22 09:59:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 09:59:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 09:59:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 09:59:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 09:59:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:59:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:59:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:59:57 [WARNING ] (13, 1, 'bot')
2018-10-22 09:59:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 09:59:57 [DEBUG   ] Finished updating board flags in 1.543 seconds
2018-10-22 10:00:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 10:00:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 10:00:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 10:00:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:00:57 [WARNING ] (13, 1, 'bot')
2018-10-22 10:00:57 [WARNING ] (13, 1, 'bot')
2018-10-22 10:00:57 [WARNING ] (13, 1, 'bot')
2018-10-22 10:00:57 [WARNING ] (13, 1, 'bot')
2018-10-22 10:00:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:00:57 [DEBUG   ] Finished updating board flags in 1.535 seconds
2018-10-22 10:01:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:01:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 10:01:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 10:01:54 [DEBUG   ] Got command RPT from MCS: ref #233420
2018-10-22 10:01:54 [DEBUG   ] summary = ERROR
2018-10-22 10:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233420  13 58413 36114757 A  ERRORERROR'
2018-10-22 10:01:54 [DEBUG   ] Got command RPT from MCS: ref #233421
2018-10-22 10:01:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:01:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233421  77 58413 36114961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:01:55 [DEBUG   ] Got command RPT from MCS: ref #233422
2018-10-22 10:01:55 [DEBUG   ] summary = ERROR
2018-10-22 10:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233422  13 58413 36115153 A  ERRORERROR'
2018-10-22 10:01:55 [DEBUG   ] Got command RPT from MCS: ref #233424
2018-10-22 10:01:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233424  77 58413 36115357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:01:55 [DEBUG   ] Got command RPT from MCS: ref #233425
2018-10-22 10:01:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233425  12 58413 36115561 A  ERRORB˜™š'
2018-10-22 10:01:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:01:57 [WARNING ] (13, 1, 'bot')
2018-10-22 10:01:57 [WARNING ] (13, 1, 'bot')
2018-10-22 10:01:57 [WARNING ] (13, 1, 'bot')
2018-10-22 10:01:57 [WARNING ] (13, 1, 'bot')
2018-10-22 10:01:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:01:57 [DEBUG   ] Finished updating board flags in 1.563 seconds
2018-10-22 10:02:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:02:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:02:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 10:02:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 10:02:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:02:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 10:02:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:02:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:02:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:02:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:02:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:02:58 [DEBUG   ] Finished updating board flags in 2.213 seconds
2018-10-22 10:03:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 10:03:28 [DEBUG   ] Got command RPT from MCS: ref #233434
2018-10-22 10:03:28 [DEBUG   ] summary = ERROR
2018-10-22 10:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233434  13 58413 36208869 A  ERRORERROR'
2018-10-22 10:03:28 [DEBUG   ] Got command RPT from MCS: ref #233435
2018-10-22 10:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233435  77 58413 36208870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:03:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 10:03:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:03:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:03:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:03:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:03:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:03:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:03:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:03:58 [DEBUG   ] Finished updating board flags in 2.239 seconds
2018-10-22 10:04:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 10:04:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 10:04:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:04:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:04:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:04:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:04:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:04:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:04:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:04:58 [DEBUG   ] Finished updating board flags in 2.068 seconds
2018-10-22 10:05:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:05:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 10:05:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 10:05:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:05:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:05:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:05:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:05:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:05:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:05:58 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-10-22 10:06:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 10:06:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:06:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:06:54 [DEBUG   ] Got command RPT from MCS: ref #233455
2018-10-22 10:06:54 [DEBUG   ] summary = ERROR
2018-10-22 10:06:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233455  13 58413 36414837 A  ERRORERROR'
2018-10-22 10:06:55 [DEBUG   ] Got command RPT from MCS: ref #233456
2018-10-22 10:06:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233456  77 58413 36415041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:06:55 [DEBUG   ] Got command RPT from MCS: ref #233457
2018-10-22 10:06:55 [DEBUG   ] summary = ERROR
2018-10-22 10:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233457  13 58413 36415233 A  ERRORERROR'
2018-10-22 10:06:55 [DEBUG   ] Got command RPT from MCS: ref #233458
2018-10-22 10:06:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233458  77 58413 36415437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:06:55 [DEBUG   ] Got command RPT from MCS: ref #233459
2018-10-22 10:06:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233459  12 58413 36415641 A  ERRORB—™š'
2018-10-22 10:06:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:06:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:06:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:06:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:06:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:06:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:06:58 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-10-22 10:07:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 10:07:30 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-22 10:07:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-22 10:07:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:07:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 10:07:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:07:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:07:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:07:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:07:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:07:58 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-22 10:08:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:08:28 [DEBUG   ] Got command RPT from MCS: ref #233460
2018-10-22 10:08:28 [DEBUG   ] summary = ERROR
2018-10-22 10:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233460  13 58413 36508873 A  ERRORERROR'
2018-10-22 10:08:28 [DEBUG   ] Got command RPT from MCS: ref #233461
2018-10-22 10:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233461  77 58413 36508874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:08:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 10:08:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:08:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 10:08:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:08:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:08:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:08:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:08:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:08:58 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-10-22 10:09:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 10:09:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:09:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:09:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:09:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:09:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:09:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:09:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:09:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:09:58 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-10-22 10:10:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:10:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 10:10:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:10:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:10:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:10:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:10:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:10:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:10:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:10:58 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-22 10:11:10 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-22 10:11:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:11:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 10:11:54 [DEBUG   ] Got command RPT from MCS: ref #233483
2018-10-22 10:11:54 [DEBUG   ] summary = ERROR
2018-10-22 10:11:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233483  13 58413 36714913 A  ERRORERROR'
2018-10-22 10:11:55 [DEBUG   ] Got command RPT from MCS: ref #233484
2018-10-22 10:11:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233484  77 58413 36715117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:11:55 [DEBUG   ] Got command RPT from MCS: ref #233485
2018-10-22 10:11:55 [DEBUG   ] summary = ERROR
2018-10-22 10:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233485  13 58413 36715321 A  ERRORERROR'
2018-10-22 10:11:55 [DEBUG   ] Got command RPT from MCS: ref #233487
2018-10-22 10:11:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233487  77 58413 36715514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:11:55 [DEBUG   ] Got command RPT from MCS: ref #233489
2018-10-22 10:11:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233489  12 58413 36715718 A  ERRORB™™š'
2018-10-22 10:11:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:11:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 10:11:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:11:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:11:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:11:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:11:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:11:58 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-10-22 10:12:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 10:12:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 10:12:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 10:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:12:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:12:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:12:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:12:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:12:58 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-10-22 10:13:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-10-22 10:13:28 [DEBUG   ] Got command RPT from MCS: ref #233497
2018-10-22 10:13:28 [DEBUG   ] summary = ERROR
2018-10-22 10:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233497  13 58413 36808869 A  ERRORERROR'
2018-10-22 10:13:28 [DEBUG   ] Got command RPT from MCS: ref #233498
2018-10-22 10:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233498  77 58413 36808870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:13:31 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-10-22 10:13:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 10:13:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 10:13:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:13:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:13:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:13:58 [WARNING ] (13, 1, 'bot')
2018-10-22 10:13:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:13:58 [DEBUG   ] Finished updating board flags in 1.535 seconds
2018-10-22 10:14:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:14:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 10:14:51 [DEBUG   ] Finished updating ant stats in 1.598 seconds
2018-10-22 10:14:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:14:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:14:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:14:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:14:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:14:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:14:59 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-10-22 10:15:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 10:15:31 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-10-22 10:15:51 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2018-10-22 10:15:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:15:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:15:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:15:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:15:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:15:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:15:59 [DEBUG   ] Finished updating board flags in 2.165 seconds
2018-10-22 10:16:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 10:16:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:16:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 10:16:54 [DEBUG   ] Got command RPT from MCS: ref #233518
2018-10-22 10:16:54 [DEBUG   ] summary = ERROR
2018-10-22 10:16:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233518  13 58413 37014989 A  ERRORERROR'
2018-10-22 10:16:55 [DEBUG   ] Got command RPT from MCS: ref #233519
2018-10-22 10:16:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233519  77 58413 37015193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:16:55 [DEBUG   ] Got command RPT from MCS: ref #233520
2018-10-22 10:16:55 [DEBUG   ] summary = ERROR
2018-10-22 10:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233520  13 58413 37015397 A  ERRORERROR'
2018-10-22 10:16:55 [DEBUG   ] Got command RPT from MCS: ref #233521
2018-10-22 10:16:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233521  77 58413 37015601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:16:55 [DEBUG   ] Got command RPT from MCS: ref #233522
2018-10-22 10:16:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233522  12 58413 37015793 A  ERRORB™™š'
2018-10-22 10:16:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:16:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:16:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:16:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:16:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:16:59 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-10-22 10:17:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:17:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 10:17:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:17:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:17:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:17:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:17:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:17:59 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-10-22 10:18:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:18:28 [DEBUG   ] Got command RPT from MCS: ref #233527
2018-10-22 10:18:28 [DEBUG   ] summary = ERROR
2018-10-22 10:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233527  13 58413 37108866 A  ERRORERROR'
2018-10-22 10:18:28 [DEBUG   ] Got command RPT from MCS: ref #233528
2018-10-22 10:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233528  77 58413 37108866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:18:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:18:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:18:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 10:18:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:18:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:18:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:18:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:18:59 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-10-22 10:19:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:19:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:19:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:19:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:19:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:19:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:19:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:19:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:19:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:19:59 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-10-22 10:20:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:20:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:20:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:20:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:20:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:20:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:20:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:20:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:20:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:20:59 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-10-22 10:21:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:21:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:21:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:21:55 [DEBUG   ] Got command RPT from MCS: ref #233550
2018-10-22 10:21:55 [DEBUG   ] summary = ERROR
2018-10-22 10:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233550  13 58413 37315073 A  ERRORERROR'
2018-10-22 10:21:55 [DEBUG   ] Got command RPT from MCS: ref #233551
2018-10-22 10:21:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233551  77 58413 37315277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:21:55 [DEBUG   ] Got command RPT from MCS: ref #233552
2018-10-22 10:21:55 [DEBUG   ] summary = ERROR
2018-10-22 10:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233552  13 58413 37315469 A  ERRORERROR'
2018-10-22 10:21:55 [DEBUG   ] Got command RPT from MCS: ref #233553
2018-10-22 10:21:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233553  77 58413 37315673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:21:55 [DEBUG   ] Got command RPT from MCS: ref #233556
2018-10-22 10:21:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:21:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233556  12 58413 37315877 A  ERRORB˜™š'
2018-10-22 10:21:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 10:21:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:21:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:21:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:21:59 [WARNING ] (13, 1, 'bot')
2018-10-22 10:21:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:21:59 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-10-22 10:22:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:22:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:22:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 10:22:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:23:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:23:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:23:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:23:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:23:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:23:00 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-10-22 10:23:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:23:28 [DEBUG   ] Got command RPT from MCS: ref #233560
2018-10-22 10:23:28 [DEBUG   ] summary = ERROR
2018-10-22 10:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233560  13 58413 37408873 A  ERRORERROR'
2018-10-22 10:23:28 [DEBUG   ] Got command RPT from MCS: ref #233561
2018-10-22 10:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233561  77 58413 37408874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:23:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:23:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:23:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:24:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 10:24:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:24:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:24:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:24:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:24:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:24:00 [DEBUG   ] Finished updating board flags in 2.161 seconds
2018-10-22 10:24:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:24:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:24:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:24:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:25:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:25:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:25:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:25:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:25:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:25:00 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-10-22 10:25:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 10:25:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:25:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:25:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:26:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:26:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:26:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:26:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:26:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:26:00 [DEBUG   ] Finished updating board flags in 1.676 seconds
2018-10-22 10:26:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 10:26:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 10:26:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:26:55 [DEBUG   ] Got command RPT from MCS: ref #233581
2018-10-22 10:26:55 [DEBUG   ] summary = ERROR
2018-10-22 10:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233581  13 58413 37615157 A  ERRORERROR'
2018-10-22 10:26:55 [DEBUG   ] Got command RPT from MCS: ref #233582
2018-10-22 10:26:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233582  77 58413 37615349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:26:55 [DEBUG   ] Got command RPT from MCS: ref #233583
2018-10-22 10:26:55 [DEBUG   ] summary = ERROR
2018-10-22 10:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233583  13 58413 37615553 A  ERRORERROR'
2018-10-22 10:26:55 [DEBUG   ] Got command RPT from MCS: ref #233584
2018-10-22 10:26:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233584  77 58413 37615757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:26:55 [DEBUG   ] Got command RPT from MCS: ref #233585
2018-10-22 10:26:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:26:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233585  12 58413 37615961 A  ERRORB˜™š'
2018-10-22 10:26:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:27:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:27:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:27:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:27:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:27:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:27:00 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-10-22 10:27:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 10:27:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 10:27:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:28:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:28:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:28:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:28:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:28:00 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-10-22 10:28:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:28:28 [DEBUG   ] Got command RPT from MCS: ref #233590
2018-10-22 10:28:28 [DEBUG   ] summary = ERROR
2018-10-22 10:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233590  13 58413 37708865 A  ERRORERROR'
2018-10-22 10:28:28 [DEBUG   ] Got command RPT from MCS: ref #233591
2018-10-22 10:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233591  77 58413 37708866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:28:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 10:28:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 10:28:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:29:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:29:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:29:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:29:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:29:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:29:00 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-10-22 10:29:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:29:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:29:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:29:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:30:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:30:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:30:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:30:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:30:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:30:00 [DEBUG   ] Finished updating board flags in 1.688 seconds
2018-10-22 10:30:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 10:30:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-10-22 10:30:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:30:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:31:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:31:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:31:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:31:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:31:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:31:00 [DEBUG   ] Finished updating board flags in 1.498 seconds
2018-10-22 10:31:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:31:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 10:31:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:31:55 [DEBUG   ] Got command RPT from MCS: ref #233613
2018-10-22 10:31:55 [DEBUG   ] summary = ERROR
2018-10-22 10:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233613  13 58413 37915237 A  ERRORERROR'
2018-10-22 10:31:55 [DEBUG   ] Got command RPT from MCS: ref #233614
2018-10-22 10:31:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233614  77 58413 37915429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:31:55 [DEBUG   ] Got command RPT from MCS: ref #233615
2018-10-22 10:31:55 [DEBUG   ] summary = ERROR
2018-10-22 10:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233615  13 58413 37915633 A  ERRORERROR'
2018-10-22 10:31:55 [DEBUG   ] Got command RPT from MCS: ref #233617
2018-10-22 10:31:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233617  77 58413 37915837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:31:56 [DEBUG   ] Got command RPT from MCS: ref #233619
2018-10-22 10:31:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233619  12 58413 37916041 A  ERRORB—™š'
2018-10-22 10:31:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:32:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:32:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:32:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:32:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:32:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:32:00 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-10-22 10:32:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 10:32:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:32:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 10:33:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:33:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:33:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:33:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:33:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:33:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:33:00 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-10-22 10:33:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:33:28 [DEBUG   ] Got command RPT from MCS: ref #233627
2018-10-22 10:33:28 [DEBUG   ] summary = ERROR
2018-10-22 10:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233627  13 58413 38008869 A  ERRORERROR'
2018-10-22 10:33:28 [DEBUG   ] Got command RPT from MCS: ref #233628
2018-10-22 10:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233628  77 58413 38008870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:33:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:33:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:34:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:34:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:34:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:34:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:34:00 [WARNING ] (13, 1, 'bot')
2018-10-22 10:34:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:34:00 [DEBUG   ] Finished updating board flags in 1.519 seconds
2018-10-22 10:34:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:34:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:34:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:35:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:35:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:35:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:35:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:35:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:35:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:35:01 [DEBUG   ] Finished updating board flags in 2.155 seconds
2018-10-22 10:35:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 10:35:32 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-22 10:35:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 10:36:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:36:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:36:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:36:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:36:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:36:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:36:01 [DEBUG   ] Finished updating board flags in 1.937 seconds
2018-10-22 10:36:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:36:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 10:36:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:36:55 [DEBUG   ] Got command RPT from MCS: ref #233648
2018-10-22 10:36:55 [DEBUG   ] summary = ERROR
2018-10-22 10:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233648  13 58413 38215321 A  ERRORERROR'
2018-10-22 10:36:55 [DEBUG   ] Got command RPT from MCS: ref #233649
2018-10-22 10:36:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233649  77 58413 38215513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:36:55 [DEBUG   ] Got command RPT from MCS: ref #233650
2018-10-22 10:36:55 [DEBUG   ] summary = ERROR
2018-10-22 10:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233650  13 58413 38215717 A  ERRORERROR'
2018-10-22 10:36:55 [DEBUG   ] Got command RPT from MCS: ref #233651
2018-10-22 10:36:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:36:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233651  77 58413 38215921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:36:56 [DEBUG   ] Got command RPT from MCS: ref #233652
2018-10-22 10:36:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233652  12 58413 38216125 A  ERRORB˜™š'
2018-10-22 10:37:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:37:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:37:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:37:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:37:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:37:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:37:01 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-10-22 10:37:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:37:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 10:37:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 10:38:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:38:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 10:38:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:38:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:38:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:38:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:38:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:38:01 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-10-22 10:38:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 10:38:28 [DEBUG   ] Got command RPT from MCS: ref #233653
2018-10-22 10:38:28 [DEBUG   ] summary = ERROR
2018-10-22 10:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233653  13 58413 38308869 A  ERRORERROR'
2018-10-22 10:38:28 [DEBUG   ] Got command RPT from MCS: ref #233654
2018-10-22 10:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233654  77 58413 38308870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:38:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:38:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:39:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:39:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:39:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:39:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:39:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:39:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:39:01 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-10-22 10:39:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 10:39:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 10:39:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:40:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:40:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 10:40:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:40:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:40:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:40:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:40:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:40:01 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-22 10:40:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:40:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-10-22 10:40:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 10:41:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:41:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:41:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:41:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:41:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:41:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:41:01 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-10-22 10:41:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 10:41:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:41:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 10:41:55 [DEBUG   ] Got command RPT from MCS: ref #233676
2018-10-22 10:41:55 [DEBUG   ] summary = ERROR
2018-10-22 10:41:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233676  13 58413 38515389 A  ERRORERROR'
2018-10-22 10:41:55 [DEBUG   ] Got command RPT from MCS: ref #233677
2018-10-22 10:41:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:41:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233677  77 58413 38515593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:41:55 [DEBUG   ] Got command RPT from MCS: ref #233678
2018-10-22 10:41:55 [DEBUG   ] summary = ERROR
2018-10-22 10:41:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233678  13 58413 38515797 A  ERRORERROR'
2018-10-22 10:41:56 [DEBUG   ] Got command RPT from MCS: ref #233680
2018-10-22 10:41:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:41:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233680  77 58413 38516001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:41:56 [DEBUG   ] Got command RPT from MCS: ref #233681
2018-10-22 10:41:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:41:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233681  12 58413 38516193 A  ERRORB™™š'
2018-10-22 10:42:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 10:42:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:42:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:42:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:42:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:42:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:42:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:42:01 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-10-22 10:42:12 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-22 10:42:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 10:42:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 10:43:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 10:43:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:43:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:43:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:43:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:43:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:43:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:43:01 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-10-22 10:43:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:43:28 [DEBUG   ] Got command RPT from MCS: ref #233690
2018-10-22 10:43:28 [DEBUG   ] summary = ERROR
2018-10-22 10:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233690  13 58413 38608869 A  ERRORERROR'
2018-10-22 10:43:28 [DEBUG   ] Got command RPT from MCS: ref #233691
2018-10-22 10:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233691  77 58413 38608870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:43:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:43:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:44:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:44:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:44:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:44:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:44:01 [WARNING ] (13, 1, 'bot')
2018-10-22 10:44:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:44:01 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-10-22 10:44:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:44:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 10:44:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:45:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:45:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:45:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:45:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:45:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:45:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:45:02 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-22 10:45:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 10:45:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:45:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:46:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:46:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:46:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:46:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:46:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:46:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:46:02 [DEBUG   ] Finished updating board flags in 2.154 seconds
2018-10-22 10:46:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:46:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 10:46:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:46:55 [DEBUG   ] Got command RPT from MCS: ref #233711
2018-10-22 10:46:55 [DEBUG   ] summary = ERROR
2018-10-22 10:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233711  13 58413 38815477 A  ERRORERROR'
2018-10-22 10:46:55 [DEBUG   ] Got command RPT from MCS: ref #233712
2018-10-22 10:46:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233712  77 58413 38815681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:46:55 [DEBUG   ] Got command RPT from MCS: ref #233713
2018-10-22 10:46:55 [DEBUG   ] summary = ERROR
2018-10-22 10:46:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233713  13 58413 38815873 A  ERRORERROR'
2018-10-22 10:46:56 [DEBUG   ] Got command RPT from MCS: ref #233714
2018-10-22 10:46:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233714  77 58413 38816077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:46:56 [DEBUG   ] Got command RPT from MCS: ref #233715
2018-10-22 10:46:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233715  12 58413 38816281 A  ERRORB™™š'
2018-10-22 10:47:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:47:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:47:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:47:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:47:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:47:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:47:02 [DEBUG   ] Finished updating board flags in 1.877 seconds
2018-10-22 10:47:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 10:47:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:47:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 10:48:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:48:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:48:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:48:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:48:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:48:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:48:02 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-10-22 10:48:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:48:28 [DEBUG   ] Got command RPT from MCS: ref #233720
2018-10-22 10:48:28 [DEBUG   ] summary = ERROR
2018-10-22 10:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233720  13 58413 38908873 A  ERRORERROR'
2018-10-22 10:48:28 [DEBUG   ] Got command RPT from MCS: ref #233721
2018-10-22 10:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233721  77 58413 38908874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:48:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:48:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:49:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:49:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:49:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:49:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:49:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:49:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:49:02 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-10-22 10:49:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 10:49:32 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 10:49:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-22 10:50:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:50:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 10:50:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 10:50:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:50:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:50:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:50:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:50:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:50:02 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-10-22 10:50:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 10:50:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 10:50:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 10:51:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:51:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:51:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:51:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:51:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:51:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:51:02 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-10-22 10:51:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 10:51:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:51:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 10:51:55 [DEBUG   ] Got command RPT from MCS: ref #233743
2018-10-22 10:51:55 [DEBUG   ] summary = ERROR
2018-10-22 10:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233743  13 58413 39115561 A  ERRORERROR'
2018-10-22 10:51:55 [DEBUG   ] Got command RPT from MCS: ref #233744
2018-10-22 10:51:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233744  77 58413 39115753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:51:55 [DEBUG   ] Got command RPT from MCS: ref #233745
2018-10-22 10:51:55 [DEBUG   ] summary = ERROR
2018-10-22 10:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233745  13 58413 39115957 A  ERRORERROR'
2018-10-22 10:51:56 [DEBUG   ] Got command RPT from MCS: ref #233747
2018-10-22 10:51:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233747  77 58413 39116161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:51:56 [DEBUG   ] Got command RPT from MCS: ref #233749
2018-10-22 10:51:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233749  12 58413 39116365 A  ERRORB˜™š'
2018-10-22 10:52:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:52:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:52:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:52:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:52:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:52:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:52:02 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-10-22 10:52:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 10:52:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:52:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:53:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:53:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:53:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:53:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:53:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:53:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:53:02 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-10-22 10:53:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 10:53:28 [DEBUG   ] Got command RPT from MCS: ref #233753
2018-10-22 10:53:28 [DEBUG   ] summary = ERROR
2018-10-22 10:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233753  13 58413 39208877 A  ERRORERROR'
2018-10-22 10:53:28 [DEBUG   ] Got command RPT from MCS: ref #233754
2018-10-22 10:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233754  77 58413 39208878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:53:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 10:53:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:54:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:54:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:54:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:54:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:54:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:54:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:54:02 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-22 10:54:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:54:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 10:54:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 10:55:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:55:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:55:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:55:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:55:02 [WARNING ] (13, 1, 'bot')
2018-10-22 10:55:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:55:02 [DEBUG   ] Finished updating board flags in 1.333 seconds
2018-10-22 10:55:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 10:55:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 10:55:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 10:56:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 10:56:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:56:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:56:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:56:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:56:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:56:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:56:03 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-10-22 10:56:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 10:56:33 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-10-22 10:56:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 10:56:55 [DEBUG   ] Got command RPT from MCS: ref #233774
2018-10-22 10:56:55 [DEBUG   ] summary = ERROR
2018-10-22 10:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233774  13 58413 39415641 A  ERRORERROR'
2018-10-22 10:56:55 [DEBUG   ] Got command RPT from MCS: ref #233775
2018-10-22 10:56:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233775  77 58413 39415833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:56:56 [DEBUG   ] Got command RPT from MCS: ref #233776
2018-10-22 10:56:56 [DEBUG   ] summary = ERROR
2018-10-22 10:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233776  13 58413 39416037 A  ERRORERROR'
2018-10-22 10:56:56 [DEBUG   ] Got command RPT from MCS: ref #233777
2018-10-22 10:56:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233777  77 58413 39416241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:56:56 [DEBUG   ] Got command RPT from MCS: ref #233778
2018-10-22 10:56:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 10:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233778  12 58413 39416445 A  ERRORB˜™š'
2018-10-22 10:57:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:57:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:57:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:57:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:57:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:57:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:57:03 [DEBUG   ] Finished updating board flags in 2.185 seconds
2018-10-22 10:57:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 10:57:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 10:57:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 10:58:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:58:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:58:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:58:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:58:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:58:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:58:03 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-10-22 10:58:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:58:28 [DEBUG   ] Got command RPT from MCS: ref #233783
2018-10-22 10:58:28 [DEBUG   ] summary = ERROR
2018-10-22 10:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233783  13 58413 39508877 A  ERRORERROR'
2018-10-22 10:58:28 [DEBUG   ] Got command RPT from MCS: ref #233784
2018-10-22 10:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 10:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233784  77 58413 39508878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 10:58:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 10:58:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 10:59:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 10:59:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:59:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:59:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:59:03 [WARNING ] (13, 1, 'bot')
2018-10-22 10:59:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 10:59:03 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-10-22 10:59:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:59:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 10:59:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 11:00:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:00:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:00:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:00:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:00:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:00:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:00:03 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-22 11:00:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-10-22 11:00:34 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-10-22 11:00:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-10-22 11:01:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:01:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 11:01:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:01:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:01:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:01:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:01:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:01:03 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-10-22 11:01:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 11:01:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 11:01:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:01:55 [DEBUG   ] Got command RPT from MCS: ref #233806
2018-10-22 11:01:55 [DEBUG   ] summary = ERROR
2018-10-22 11:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233806  13 58413 39715721 A  ERRORERROR'
2018-10-22 11:01:55 [DEBUG   ] Got command RPT from MCS: ref #233807
2018-10-22 11:01:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233807  77 58413 39715913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:01:56 [DEBUG   ] Got command RPT from MCS: ref #233808
2018-10-22 11:01:56 [DEBUG   ] summary = ERROR
2018-10-22 11:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233808  13 58413 39716117 A  ERRORERROR'
2018-10-22 11:01:56 [DEBUG   ] Got command RPT from MCS: ref #233810
2018-10-22 11:01:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233810  77 58413 39716321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:01:56 [DEBUG   ] Got command RPT from MCS: ref #233812
2018-10-22 11:01:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233812  12 58413 39716525 A  ERRORB™™š'
2018-10-22 11:02:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:02:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:02:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:02:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:02:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:02:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:02:03 [DEBUG   ] Finished updating board flags in 1.684 seconds
2018-10-22 11:02:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 11:02:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-10-22 11:02:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 11:03:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:03:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:03:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:03:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:03:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:03:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:03:03 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-10-22 11:03:14 [DEBUG   ] Finished updating ant stats in 0.866 seconds
2018-10-22 11:03:28 [DEBUG   ] Got command RPT from MCS: ref #233820
2018-10-22 11:03:28 [DEBUG   ] summary = ERROR
2018-10-22 11:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233820  13 58413 39808881 A  ERRORERROR'
2018-10-22 11:03:28 [DEBUG   ] Got command RPT from MCS: ref #233821
2018-10-22 11:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233821  77 58413 39808882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:03:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 11:03:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:04:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 11:04:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:04:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 11:04:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 11:04:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:04:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:04:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:04:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:04:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:04:03 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-10-22 11:04:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 11:04:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:04:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 11:05:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:05:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-10-22 11:05:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:05:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:05:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:05:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:05:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:05:03 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-10-22 11:05:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:05:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 11:05:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:06:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:06:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:06:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:06:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:06:03 [WARNING ] (13, 1, 'bot')
2018-10-22 11:06:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:06:03 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-10-22 11:06:14 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2018-10-22 11:06:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-10-22 11:06:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 11:06:55 [DEBUG   ] Got command RPT from MCS: ref #233841
2018-10-22 11:06:55 [DEBUG   ] summary = ERROR
2018-10-22 11:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233841  13 58413 40015801 A  ERRORERROR'
2018-10-22 11:06:55 [DEBUG   ] Got command RPT from MCS: ref #233842
2018-10-22 11:06:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:06:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233842  77 58413 40015993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:06:56 [DEBUG   ] Got command RPT from MCS: ref #233843
2018-10-22 11:06:56 [DEBUG   ] summary = ERROR
2018-10-22 11:06:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233843  13 58413 40016197 A  ERRORERROR'
2018-10-22 11:06:56 [DEBUG   ] Got command RPT from MCS: ref #233844
2018-10-22 11:06:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:06:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233844  77 58413 40016401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:06:56 [DEBUG   ] Got command RPT from MCS: ref #233845
2018-10-22 11:06:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:06:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233845  12 58413 40016605 A  ERRORB™™š'
2018-10-22 11:07:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:07:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:07:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:07:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:07:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:07:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:07:04 [DEBUG   ] Finished updating board flags in 2.239 seconds
2018-10-22 11:07:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 11:07:35 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-10-22 11:07:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 11:08:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:08:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 11:08:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 11:08:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:08:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:08:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:08:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:08:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:08:04 [DEBUG   ] Finished updating board flags in 2.147 seconds
2018-10-22 11:08:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:08:28 [DEBUG   ] Got command RPT from MCS: ref #233846
2018-10-22 11:08:28 [DEBUG   ] summary = ERROR
2018-10-22 11:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233846  13 58413 40108873 A  ERRORERROR'
2018-10-22 11:08:28 [DEBUG   ] Got command RPT from MCS: ref #233847
2018-10-22 11:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233847  77 58413 40108874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:08:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 11:08:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:09:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 11:09:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:09:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:09:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:09:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:09:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:09:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:09:04 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-10-22 11:09:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:09:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:09:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 11:10:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:10:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 11:10:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:10:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:10:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:10:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:10:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:10:04 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-22 11:10:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 11:10:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:10:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:11:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:11:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:11:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:11:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:11:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:11:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:11:04 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-10-22 11:11:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 11:11:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:11:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:11:55 [DEBUG   ] Got command RPT from MCS: ref #233869
2018-10-22 11:11:55 [DEBUG   ] summary = ERROR
2018-10-22 11:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233869  13 58413 40315881 A  ERRORERROR'
2018-10-22 11:11:56 [DEBUG   ] Got command RPT from MCS: ref #233870
2018-10-22 11:11:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233870  77 58413 40316073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:11:56 [DEBUG   ] Got command RPT from MCS: ref #233871
2018-10-22 11:11:56 [DEBUG   ] summary = ERROR
2018-10-22 11:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233871  13 58413 40316277 A  ERRORERROR'
2018-10-22 11:11:56 [DEBUG   ] Got command RPT from MCS: ref #233873
2018-10-22 11:11:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233873  77 58413 40316481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:11:56 [DEBUG   ] Got command RPT from MCS: ref #233874
2018-10-22 11:11:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233874  12 58413 40316685 A  ERRORB™™š'
2018-10-22 11:12:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:12:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:12:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:12:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:12:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:12:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:12:04 [DEBUG   ] Finished updating board flags in 1.854 seconds
2018-10-22 11:12:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:12:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 11:12:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:13:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:13:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 11:13:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:13:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:13:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:13:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:13:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:13:04 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-10-22 11:13:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:13:28 [DEBUG   ] Got command RPT from MCS: ref #233883
2018-10-22 11:13:28 [DEBUG   ] summary = ERROR
2018-10-22 11:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233883  13 58413 40408881 A  ERRORERROR'
2018-10-22 11:13:28 [DEBUG   ] Got command RPT from MCS: ref #233884
2018-10-22 11:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233884  77 58413 40408882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:13:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:13:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 11:14:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:14:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:14:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:14:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:14:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:14:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:14:04 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-10-22 11:14:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:14:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:14:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:15:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:15:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:15:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:15:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:15:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:15:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:15:04 [DEBUG   ] Finished updating board flags in 1.736 seconds
2018-10-22 11:15:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 11:15:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-10-22 11:15:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:16:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:16:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:16:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:16:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:16:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:16:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:16:04 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-10-22 11:16:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:16:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:16:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:16:55 [DEBUG   ] Got command RPT from MCS: ref #233904
2018-10-22 11:16:55 [DEBUG   ] summary = ERROR
2018-10-22 11:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233904  13 58413 40615953 A  ERRORERROR'
2018-10-22 11:16:56 [DEBUG   ] Got command RPT from MCS: ref #233905
2018-10-22 11:16:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233905  77 58413 40616157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:16:56 [DEBUG   ] Got command RPT from MCS: ref #233906
2018-10-22 11:16:56 [DEBUG   ] summary = ERROR
2018-10-22 11:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233906  13 58413 40616361 A  ERRORERROR'
2018-10-22 11:16:56 [DEBUG   ] Got command RPT from MCS: ref #233907
2018-10-22 11:16:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233907  77 58413 40616565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:16:56 [DEBUG   ] Got command RPT from MCS: ref #233908
2018-10-22 11:16:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233908  12 58413 40616757 A  ERRORB˜™š'
2018-10-22 11:17:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:17:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:17:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:17:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:17:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:17:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:17:04 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-10-22 11:17:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:17:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:17:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 11:18:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:18:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:18:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:18:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:18:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:18:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:18:04 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-10-22 11:18:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:18:28 [DEBUG   ] Got command RPT from MCS: ref #233913
2018-10-22 11:18:28 [DEBUG   ] summary = ERROR
2018-10-22 11:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233913  13 58413 40708885 A  ERRORERROR'
2018-10-22 11:18:28 [DEBUG   ] Got command RPT from MCS: ref #233914
2018-10-22 11:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233914  77 58413 40708886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:18:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:18:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:19:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:19:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:19:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:19:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:19:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:19:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:19:04 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-10-22 11:19:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:19:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:19:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:20:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:20:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:20:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:20:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:20:04 [WARNING ] (13, 1, 'bot')
2018-10-22 11:20:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:20:04 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-22 11:20:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:20:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 11:20:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:21:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:21:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:21:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:21:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:21:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:21:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:21:05 [DEBUG   ] Finished updating board flags in 2.216 seconds
2018-10-22 11:21:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 11:21:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 11:21:56 [DEBUG   ] Got command RPT from MCS: ref #233936
2018-10-22 11:21:56 [DEBUG   ] summary = ERROR
2018-10-22 11:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233936  13 58413 40916033 A  ERRORERROR'
2018-10-22 11:21:56 [DEBUG   ] Got command RPT from MCS: ref #233937
2018-10-22 11:21:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233937  77 58413 40916237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:21:56 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2018-10-22 11:21:56 [DEBUG   ] Got command RPT from MCS: ref #233938
2018-10-22 11:21:56 [DEBUG   ] summary = ERROR
2018-10-22 11:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233938  13 58413 40916441 A  ERRORERROR'
2018-10-22 11:21:56 [DEBUG   ] Got command RPT from MCS: ref #233940
2018-10-22 11:21:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233940  77 58413 40916645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:21:56 [DEBUG   ] Got command RPT from MCS: ref #233942
2018-10-22 11:21:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233942  12 58413 40916837 A  ERRORB˜™š'
2018-10-22 11:22:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:22:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:22:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:22:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:22:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:22:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:22:05 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-10-22 11:22:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 11:22:36 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-10-22 11:22:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 11:23:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:23:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 11:23:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:23:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:23:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:23:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:23:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:23:05 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-10-22 11:23:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 11:23:28 [DEBUG   ] Got command RPT from MCS: ref #233946
2018-10-22 11:23:28 [DEBUG   ] summary = ERROR
2018-10-22 11:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233946  13 58413 41008881 A  ERRORERROR'
2018-10-22 11:23:28 [DEBUG   ] Got command RPT from MCS: ref #233947
2018-10-22 11:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233947  77 58413 41008882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:23:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 11:23:56 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-10-22 11:24:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:24:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 11:24:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:24:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:24:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:24:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:24:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:24:05 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-10-22 11:24:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 11:24:36 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2018-10-22 11:24:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 11:25:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:25:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:25:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:25:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:25:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:25:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:25:05 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-10-22 11:25:16 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2018-10-22 11:25:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 11:25:56 [DEBUG   ] Finished updating ant stats in 1.599 seconds
2018-10-22 11:26:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:26:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:26:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:26:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:26:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:26:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:26:05 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-10-22 11:26:15 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-10-22 11:26:36 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-10-22 11:26:55 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-10-22 11:26:56 [DEBUG   ] Got command RPT from MCS: ref #233967
2018-10-22 11:26:56 [DEBUG   ] summary = ERROR
2018-10-22 11:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233967  13 58413 41216113 A  ERRORERROR'
2018-10-22 11:26:56 [DEBUG   ] Got command RPT from MCS: ref #233968
2018-10-22 11:26:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233968  77 58413 41216317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:26:56 [DEBUG   ] Got command RPT from MCS: ref #233969
2018-10-22 11:26:56 [DEBUG   ] summary = ERROR
2018-10-22 11:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233969  13 58413 41216521 A  ERRORERROR'
2018-10-22 11:26:56 [DEBUG   ] Got command RPT from MCS: ref #233970
2018-10-22 11:26:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233970  77 58413 41216725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:26:56 [DEBUG   ] Got command RPT from MCS: ref #233971
2018-10-22 11:26:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:26:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233971  12 58413 41216917 A  ERRORB™™š'
2018-10-22 11:27:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:27:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:27:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:27:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:27:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:27:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:27:05 [DEBUG   ] Finished updating board flags in 1.894 seconds
2018-10-22 11:27:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 11:27:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 11:27:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 11:28:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:28:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:28:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:28:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:28:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:28:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:28:05 [DEBUG   ] Finished updating board flags in 1.679 seconds
2018-10-22 11:28:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 11:28:28 [DEBUG   ] Got command RPT from MCS: ref #233976
2018-10-22 11:28:28 [DEBUG   ] summary = ERROR
2018-10-22 11:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233976  13 58413 41308881 A  ERRORERROR'
2018-10-22 11:28:28 [DEBUG   ] Got command RPT from MCS: ref #233977
2018-10-22 11:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233977  77 58413 41308882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:28:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 11:28:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 11:29:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:29:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-10-22 11:29:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:29:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:29:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:29:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:29:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:29:05 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-22 11:29:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:29:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 11:29:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:30:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:30:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:30:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:30:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:30:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:30:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:30:05 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-22 11:30:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:30:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:30:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 11:31:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:31:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:31:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:31:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:31:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:31:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:31:05 [DEBUG   ] Finished updating board flags in 1.567 seconds
2018-10-22 11:31:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 11:31:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 11:31:56 [DEBUG   ] Got command RPT from MCS: ref #233999
2018-10-22 11:31:56 [DEBUG   ] summary = ERROR
2018-10-22 11:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   233999  13 58413 41516197 A  ERRORERROR'
2018-10-22 11:31:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:31:56 [DEBUG   ] Got command RPT from MCS: ref #234000
2018-10-22 11:31:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234000  77 58413 41516401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:31:56 [DEBUG   ] Got command RPT from MCS: ref #234001
2018-10-22 11:31:56 [DEBUG   ] summary = ERROR
2018-10-22 11:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234001  13 58413 41516605 A  ERRORERROR'
2018-10-22 11:31:56 [DEBUG   ] Got command RPT from MCS: ref #234003
2018-10-22 11:31:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:31:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234003  77 58413 41516797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:31:57 [DEBUG   ] Got command RPT from MCS: ref #234004
2018-10-22 11:31:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:31:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234004  12 58413 41517001 A  ERRORB™™š'
2018-10-22 11:32:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:32:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 11:32:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:32:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:32:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:32:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:32:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:32:05 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-10-22 11:32:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 11:32:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:32:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:33:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 11:33:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:33:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 11:33:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:33:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:33:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:33:05 [WARNING ] (13, 1, 'bot')
2018-10-22 11:33:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:33:05 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-10-22 11:33:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:33:28 [DEBUG   ] Got command RPT from MCS: ref #234013
2018-10-22 11:33:28 [DEBUG   ] summary = ERROR
2018-10-22 11:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234013  13 58413 41608889 A  ERRORERROR'
2018-10-22 11:33:28 [DEBUG   ] Got command RPT from MCS: ref #234014
2018-10-22 11:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234014  77 58413 41608890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:33:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-10-22 11:33:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:34:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:34:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:34:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:34:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:34:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:34:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:34:06 [DEBUG   ] Finished updating board flags in 2.248 seconds
2018-10-22 11:34:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 11:34:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 11:34:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 11:35:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:35:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 11:35:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:35:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:35:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:35:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:35:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:35:06 [DEBUG   ] Finished updating board flags in 2.217 seconds
2018-10-22 11:35:16 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-10-22 11:35:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:35:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:36:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:36:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:36:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:36:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:36:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:36:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:36:06 [DEBUG   ] Finished updating board flags in 2.082 seconds
2018-10-22 11:36:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:36:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:36:56 [DEBUG   ] Got command RPT from MCS: ref #234034
2018-10-22 11:36:56 [DEBUG   ] summary = ERROR
2018-10-22 11:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234034  13 58413 41816273 A  ERRORERROR'
2018-10-22 11:36:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 11:36:56 [DEBUG   ] Got command RPT from MCS: ref #234035
2018-10-22 11:36:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234035  77 58413 41816477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:36:56 [DEBUG   ] Got command RPT from MCS: ref #234036
2018-10-22 11:36:56 [DEBUG   ] summary = ERROR
2018-10-22 11:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234036  13 58413 41816681 A  ERRORERROR'
2018-10-22 11:36:56 [DEBUG   ] Got command RPT from MCS: ref #234037
2018-10-22 11:36:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234037  77 58413 41816885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:36:57 [DEBUG   ] Got command RPT from MCS: ref #234038
2018-10-22 11:36:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:36:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234038  12 58413 41817077 A  ERRORB˜™š'
2018-10-22 11:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:37:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:37:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:37:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:37:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:37:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:37:06 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-10-22 11:37:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:37:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:37:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:38:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:38:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:38:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:38:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:38:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:38:06 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-10-22 11:38:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 11:38:28 [DEBUG   ] Got command RPT from MCS: ref #234039
2018-10-22 11:38:28 [DEBUG   ] summary = ERROR
2018-10-22 11:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234039  13 58413 41908881 A  ERRORERROR'
2018-10-22 11:38:28 [DEBUG   ] Got command RPT from MCS: ref #234040
2018-10-22 11:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234040  77 58413 41908882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:38:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:38:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 11:39:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:39:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:39:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:39:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:39:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:39:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:39:06 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-10-22 11:39:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:39:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:39:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:40:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:40:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:40:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:40:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:40:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:40:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:40:06 [DEBUG   ] Finished updating board flags in 1.933 seconds
2018-10-22 11:40:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:40:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:40:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 11:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 11:41:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:41:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:41:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:41:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:41:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:41:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:41:06 [DEBUG   ] Finished updating board flags in 1.679 seconds
2018-10-22 11:41:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:41:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 11:41:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:41:56 [DEBUG   ] Got command RPT from MCS: ref #234062
2018-10-22 11:41:56 [DEBUG   ] summary = ERROR
2018-10-22 11:41:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234062  13 58413 42116353 A  ERRORERROR'
2018-10-22 11:41:56 [DEBUG   ] Got command RPT from MCS: ref #234063
2018-10-22 11:41:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:41:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234063  77 58413 42116557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:41:56 [DEBUG   ] Got command RPT from MCS: ref #234064
2018-10-22 11:41:56 [DEBUG   ] summary = ERROR
2018-10-22 11:41:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234064  13 58413 42116761 A  ERRORERROR'
2018-10-22 11:41:56 [DEBUG   ] Got command RPT from MCS: ref #234066
2018-10-22 11:41:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:41:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234066  77 58413 42116965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:41:57 [DEBUG   ] Got command RPT from MCS: ref #234067
2018-10-22 11:41:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:41:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234067  12 58413 42117157 A  ERRORB˜™š'
2018-10-22 11:42:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:42:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:42:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:42:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:42:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:42:06 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-10-22 11:42:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 11:42:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:42:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:43:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:43:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:43:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:43:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:43:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:43:06 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-10-22 11:43:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:43:28 [DEBUG   ] Got command RPT from MCS: ref #234076
2018-10-22 11:43:28 [DEBUG   ] summary = ERROR
2018-10-22 11:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234076  13 58413 42208885 A  ERRORERROR'
2018-10-22 11:43:28 [DEBUG   ] Got command RPT from MCS: ref #234077
2018-10-22 11:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234077  77 58413 42208886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:43:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:43:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:44:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:44:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:44:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:44:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:44:06 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-10-22 11:44:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:44:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:44:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 11:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:45:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:45:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:45:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:45:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:45:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:45:06 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-10-22 11:45:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:45:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:45:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 11:46:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:46:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 11:46:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:46:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:46:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:46:06 [WARNING ] (13, 1, 'bot')
2018-10-22 11:46:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:46:06 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-10-22 11:46:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 11:46:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:46:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:46:56 [DEBUG   ] Got command RPT from MCS: ref #234097
2018-10-22 11:46:56 [DEBUG   ] summary = ERROR
2018-10-22 11:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234097  13 58413 42416429 A  ERRORERROR'
2018-10-22 11:46:56 [DEBUG   ] Got command RPT from MCS: ref #234098
2018-10-22 11:46:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234098  77 58413 42416633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:46:56 [DEBUG   ] Got command RPT from MCS: ref #234099
2018-10-22 11:46:56 [DEBUG   ] summary = ERROR
2018-10-22 11:46:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234099  13 58413 42416837 A  ERRORERROR'
2018-10-22 11:46:57 [DEBUG   ] Got command RPT from MCS: ref #234100
2018-10-22 11:46:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234100  77 58413 42417041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:46:57 [DEBUG   ] Got command RPT from MCS: ref #234101
2018-10-22 11:46:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:46:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234101  12 58413 42417233 A  ERRORB™™š'
2018-10-22 11:47:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:47:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:47:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:47:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:47:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:47:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:47:07 [DEBUG   ] Finished updating board flags in 2.250 seconds
2018-10-22 11:47:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-10-22 11:47:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 11:47:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 11:48:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 11:48:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-10-22 11:48:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:48:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:48:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:48:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:48:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:48:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:48:07 [DEBUG   ] Finished updating board flags in 2.069 seconds
2018-10-22 11:48:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-10-22 11:48:28 [DEBUG   ] Got command RPT from MCS: ref #234106
2018-10-22 11:48:28 [DEBUG   ] summary = ERROR
2018-10-22 11:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234106  13 58413 42508889 A  ERRORERROR'
2018-10-22 11:48:28 [DEBUG   ] Got command RPT from MCS: ref #234107
2018-10-22 11:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234107  77 58413 42508890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:48:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 11:48:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-10-22 11:49:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:49:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-10-22 11:49:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:49:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:49:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:49:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:49:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:49:07 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-10-22 11:49:17 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-10-22 11:49:37 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 11:49:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:50:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:50:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 11:50:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:50:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:50:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:50:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:50:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:50:07 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-10-22 11:50:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:50:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 11:50:57 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-10-22 11:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 11:51:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:51:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:51:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:51:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:51:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:51:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:51:07 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-10-22 11:51:17 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-10-22 11:51:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:51:56 [DEBUG   ] Got command RPT from MCS: ref #234129
2018-10-22 11:51:56 [DEBUG   ] summary = ERROR
2018-10-22 11:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234129  13 58413 42716509 A  ERRORERROR'
2018-10-22 11:51:56 [DEBUG   ] Got command RPT from MCS: ref #234130
2018-10-22 11:51:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234130  77 58413 42716713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:51:56 [DEBUG   ] Got command RPT from MCS: ref #234131
2018-10-22 11:51:56 [DEBUG   ] summary = ERROR
2018-10-22 11:51:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234131  13 58413 42716917 A  ERRORERROR'
2018-10-22 11:51:57 [DEBUG   ] Got command RPT from MCS: ref #234133
2018-10-22 11:51:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234133  77 58413 42717121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:51:57 [DEBUG   ] Got command RPT from MCS: ref #234134
2018-10-22 11:51:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234134  12 58413 42717313 A  ERRORB™™š'
2018-10-22 11:51:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 11:52:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:52:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:52:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:52:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:52:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:52:07 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-10-22 11:52:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 11:52:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 11:52:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 11:53:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:53:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:53:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:53:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:53:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:53:07 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-10-22 11:53:17 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-10-22 11:53:28 [DEBUG   ] Got command RPT from MCS: ref #234139
2018-10-22 11:53:28 [DEBUG   ] summary = ERROR
2018-10-22 11:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234139  13 58413 42808889 A  ERRORERROR'
2018-10-22 11:53:28 [DEBUG   ] Got command RPT from MCS: ref #234140
2018-10-22 11:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234140  77 58413 42808890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:53:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 11:53:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 11:54:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:54:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 11:54:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:54:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:54:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:54:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:54:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:54:07 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-10-22 11:54:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 11:54:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 11:54:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 11:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:55:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:55:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:55:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:55:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:55:07 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-10-22 11:55:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 11:55:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 11:55:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 11:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:56:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:56:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:56:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:56:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:56:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:56:07 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-10-22 11:56:17 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-10-22 11:56:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-10-22 11:56:56 [DEBUG   ] Got command RPT from MCS: ref #234160
2018-10-22 11:56:56 [DEBUG   ] summary = ERROR
2018-10-22 11:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234160  13 58413 43016593 A  ERRORERROR'
2018-10-22 11:56:56 [DEBUG   ] Got command RPT from MCS: ref #234161
2018-10-22 11:56:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234161  77 58413 43016797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:56:57 [DEBUG   ] Got command RPT from MCS: ref #234162
2018-10-22 11:56:57 [DEBUG   ] summary = ERROR
2018-10-22 11:56:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234162  13 58413 43017001 A  ERRORERROR'
2018-10-22 11:56:57 [DEBUG   ] Got command RPT from MCS: ref #234163
2018-10-22 11:56:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:56:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234163  77 58413 43017205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:56:57 [DEBUG   ] Got command RPT from MCS: ref #234164
2018-10-22 11:56:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 11:56:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234164  12 58413 43017397 A  ERRORB™™š'
2018-10-22 11:56:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-10-22 11:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:57:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:57:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:57:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:57:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:57:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:57:07 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-10-22 11:57:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 11:57:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:57:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 11:58:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:58:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:58:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:58:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:58:07 [WARNING ] (13, 1, 'bot')
2018-10-22 11:58:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:58:07 [DEBUG   ] Finished updating board flags in 1.364 seconds
2018-10-22 11:58:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 11:58:28 [DEBUG   ] Got command RPT from MCS: ref #234169
2018-10-22 11:58:28 [DEBUG   ] summary = ERROR
2018-10-22 11:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234169  13 58413 43108893 A  ERRORERROR'
2018-10-22 11:58:28 [DEBUG   ] Got command RPT from MCS: ref #234170
2018-10-22 11:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 11:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234170  77 58413 43108894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 11:58:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 11:58:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 11:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 11:59:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 11:59:08 [WARNING ] (13, 1, 'bot')
2018-10-22 11:59:08 [WARNING ] (13, 1, 'bot')
2018-10-22 11:59:08 [WARNING ] (13, 1, 'bot')
2018-10-22 11:59:08 [WARNING ] (13, 1, 'bot')
2018-10-22 11:59:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 11:59:08 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-10-22 11:59:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 11:59:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 11:59:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 12:00:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:00:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:00:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:00:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:00:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:00:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:00:08 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-10-22 12:00:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 12:00:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 12:00:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 12:01:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:01:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:01:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:01:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:01:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:01:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:01:08 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-10-22 12:01:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 12:01:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 12:01:56 [DEBUG   ] Got command RPT from MCS: ref #234192
2018-10-22 12:01:56 [DEBUG   ] summary = ERROR
2018-10-22 12:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234192  13 58413 43316677 A  ERRORERROR'
2018-10-22 12:01:56 [DEBUG   ] Got command RPT from MCS: ref #234193
2018-10-22 12:01:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:01:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234193  77 58413 43316881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:01:57 [DEBUG   ] Got command RPT from MCS: ref #234194
2018-10-22 12:01:57 [DEBUG   ] summary = ERROR
2018-10-22 12:01:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234194  13 58413 43317073 A  ERRORERROR'
2018-10-22 12:01:57 [DEBUG   ] Got command RPT from MCS: ref #234196
2018-10-22 12:01:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:01:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234196  77 58413 43317277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:01:57 [DEBUG   ] Got command RPT from MCS: ref #234198
2018-10-22 12:01:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 12:01:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234198  12 58413 43317481 A  ERRORB˜™š'
2018-10-22 12:01:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 12:02:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:02:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:02:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:02:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:02:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:02:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:02:08 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-10-22 12:02:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 12:02:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 12:02:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 12:03:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:03:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:03:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:03:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:03:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:03:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:03:08 [DEBUG   ] Finished updating board flags in 1.924 seconds
2018-10-22 12:03:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 12:03:28 [DEBUG   ] Got command RPT from MCS: ref #234206
2018-10-22 12:03:28 [DEBUG   ] summary = ERROR
2018-10-22 12:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234206  13 58413 43408894 A  ERRORERROR'
2018-10-22 12:03:28 [DEBUG   ] Got command RPT from MCS: ref #234207
2018-10-22 12:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234207  77 58413 43408894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:03:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 12:03:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 12:04:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:04:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:04:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:04:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:04:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:04:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:04:08 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-10-22 12:04:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 12:04:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-10-22 12:04:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 12:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:05:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:05:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:05:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:05:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:05:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:05:08 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-10-22 12:05:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 12:05:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 12:05:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 12:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:06:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:06:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:06:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:06:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:06:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:06:08 [DEBUG   ] Finished updating board flags in 1.834 seconds
2018-10-22 12:06:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 12:06:38 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-10-22 12:06:56 [DEBUG   ] Got command RPT from MCS: ref #234227
2018-10-22 12:06:56 [DEBUG   ] summary = ERROR
2018-10-22 12:06:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234227  13 58413 43616757 A  ERRORERROR'
2018-10-22 12:06:56 [DEBUG   ] Got command RPT from MCS: ref #234228
2018-10-22 12:06:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:06:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234228  77 58413 43616961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:06:57 [DEBUG   ] Got command RPT from MCS: ref #234229
2018-10-22 12:06:57 [DEBUG   ] summary = ERROR
2018-10-22 12:06:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234229  13 58413 43617153 A  ERRORERROR'
2018-10-22 12:06:57 [DEBUG   ] Got command RPT from MCS: ref #234230
2018-10-22 12:06:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:06:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234230  77 58413 43617358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:06:57 [DEBUG   ] Got command RPT from MCS: ref #234231
2018-10-22 12:06:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 12:06:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234231  12 58413 43617562 A  ERRORB™™š'
2018-10-22 12:06:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 12:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:07:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:07:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:07:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:07:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:07:08 [DEBUG   ] Finished updating board flags in 1.745 seconds
2018-10-22 12:07:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-10-22 12:07:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 12:07:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 12:08:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-10-22 12:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:08:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 12:08:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:08:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:08:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:08:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:08:08 [DEBUG   ] Finished updating board flags in 1.671 seconds
2018-10-22 12:08:18 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2018-10-22 12:08:28 [DEBUG   ] Got command RPT from MCS: ref #234232
2018-10-22 12:08:28 [DEBUG   ] summary = ERROR
2018-10-22 12:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234232  13 58413 43708889 A  ERRORERROR'
2018-10-22 12:08:28 [DEBUG   ] Got command RPT from MCS: ref #234233
2018-10-22 12:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234233  77 58413 43708890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:08:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 12:08:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 12:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:09:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 12:09:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:09:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:09:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:09:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:09:08 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-10-22 12:09:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 12:09:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 12:09:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 12:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:10:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:10:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:10:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:10:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:10:08 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-10-22 12:10:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 12:10:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 12:10:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 12:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:11:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:11:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:11:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:11:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:11:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:11:08 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-10-22 12:11:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 12:11:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 12:11:56 [DEBUG   ] Got command RPT from MCS: ref #234255
2018-10-22 12:11:56 [DEBUG   ] summary = ERROR
2018-10-22 12:11:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234255  13 58413 43916837 A  ERRORERROR'
2018-10-22 12:11:57 [DEBUG   ] Got command RPT from MCS: ref #234256
2018-10-22 12:11:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234256  77 58413 43917041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:11:57 [DEBUG   ] Got command RPT from MCS: ref #234257
2018-10-22 12:11:57 [DEBUG   ] summary = ERROR
2018-10-22 12:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234257  13 58413 43917233 A  ERRORERROR'
2018-10-22 12:11:57 [DEBUG   ] Got command RPT from MCS: ref #234259
2018-10-22 12:11:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234259  77 58413 43917437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:11:57 [DEBUG   ] Got command RPT from MCS: ref #234261
2018-10-22 12:11:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 12:11:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234261  12 58413 43917641 A  ERRORB™™š'
2018-10-22 12:11:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 12:12:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:12:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:12:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:12:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:12:08 [WARNING ] (13, 1, 'bot')
2018-10-22 12:12:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:12:08 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-10-22 12:12:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 12:12:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 12:12:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 12:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:13:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:13:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:13:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:13:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:13:09 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-10-22 12:13:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 12:13:28 [DEBUG   ] Got command RPT from MCS: ref #234269
2018-10-22 12:13:28 [DEBUG   ] summary = ERROR
2018-10-22 12:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234269  13 58413 44008893 A  ERRORERROR'
2018-10-22 12:13:28 [DEBUG   ] Got command RPT from MCS: ref #234270
2018-10-22 12:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234270  77 58413 44008894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:13:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 12:13:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-10-22 12:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:14:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:14:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:14:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:14:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:14:09 [DEBUG   ] Finished updating board flags in 2.279 seconds
2018-10-22 12:14:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-10-22 12:14:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 12:14:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-10-22 12:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:15:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:15:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:15:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:15:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:15:09 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-10-22 12:15:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-10-22 12:15:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-10-22 12:15:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 12:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:16:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:16:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:16:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:16:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:16:09 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-10-22 12:16:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 12:16:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-10-22 12:16:56 [DEBUG   ] Got command RPT from MCS: ref #234290
2018-10-22 12:16:56 [DEBUG   ] summary = ERROR
2018-10-22 12:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234290  13 58413 44216921 A  ERRORERROR'
2018-10-22 12:16:57 [DEBUG   ] Got command RPT from MCS: ref #234291
2018-10-22 12:16:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234291  77 58413 44217125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:16:57 [DEBUG   ] Got command RPT from MCS: ref #234292
2018-10-22 12:16:57 [DEBUG   ] summary = ERROR
2018-10-22 12:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234292  13 58413 44217317 A  ERRORERROR'
2018-10-22 12:16:57 [DEBUG   ] Got command RPT from MCS: ref #234293
2018-10-22 12:16:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234293  77 58413 44217521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:16:57 [DEBUG   ] Got command RPT from MCS: ref #234294
2018-10-22 12:16:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 12:16:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234294  12 58413 44217726 A  ERRORB™™š'
2018-10-22 12:16:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 12:17:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 12:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:17:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:17:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:17:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:17:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:17:09 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-10-22 12:17:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 12:17:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 12:17:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 12:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:18:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:18:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:18:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:18:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:18:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:18:09 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-10-22 12:18:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 12:18:28 [DEBUG   ] Got command RPT from MCS: ref #234299
2018-10-22 12:18:28 [DEBUG   ] summary = ERROR
2018-10-22 12:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234299  13 58413 44308893 A  ERRORERROR'
2018-10-22 12:18:28 [DEBUG   ] Got command RPT from MCS: ref #234300
2018-10-22 12:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234300  77 58413 44308894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:18:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 12:18:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-10-22 12:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:19:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:19:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:19:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:19:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:19:09 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-10-22 12:19:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 12:19:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-10-22 12:19:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-10-22 12:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:20:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:20:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:20:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:20:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:20:09 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-10-22 12:20:18 [DEBUG   ] Finished updating ant stats in 0.589 seconds
2018-10-22 12:20:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-10-22 12:20:59 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-10-22 12:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:21:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:21:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:21:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:21:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:21:09 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-10-22 12:21:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-10-22 12:21:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 12:21:57 [DEBUG   ] Got command RPT from MCS: ref #234322
2018-10-22 12:21:57 [DEBUG   ] summary = ERROR
2018-10-22 12:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234322  13 58413 44517001 A  ERRORERROR'
2018-10-22 12:21:57 [DEBUG   ] Got command RPT from MCS: ref #234323
2018-10-22 12:21:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234323  77 58413 44517193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:21:57 [DEBUG   ] Got command RPT from MCS: ref #234324
2018-10-22 12:21:57 [DEBUG   ] summary = ERROR
2018-10-22 12:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234324  13 58413 44517397 A  ERRORERROR'
2018-10-22 12:21:57 [DEBUG   ] Got command RPT from MCS: ref #234326
2018-10-22 12:21:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234326  77 58413 44517601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:21:57 [DEBUG   ] Got command RPT from MCS: ref #234328
2018-10-22 12:21:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-10-22 12:21:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234328  12 58413 44517805 A  ERRORB˜™š'
2018-10-22 12:21:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 12:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:22:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:22:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:22:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:22:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:22:09 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-10-22 12:22:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-10-22 12:22:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-10-22 12:22:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-10-22 12:23:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-10-22 12:23:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:23:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:23:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:23:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:23:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:23:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:23:09 [DEBUG   ] Finished updating board flags in 1.650 seconds
2018-10-22 12:23:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-10-22 12:23:28 [DEBUG   ] Got command RPT from MCS: ref #234332
2018-10-22 12:23:28 [DEBUG   ] summary = ERROR
2018-10-22 12:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234332  13 58413 44608897 A  ERRORERROR'
2018-10-22 12:23:28 [DEBUG   ] Got command RPT from MCS: ref #234333
2018-10-22 12:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-10-22 12:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   234333  77 58413 44608898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-10-22 12:23:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-10-22 12:23:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 12:24:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-10-22 12:24:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-10-22 12:24:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:24:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:24:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:24:09 [WARNING ] (13, 1, 'bot')
2018-10-22 12:24:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-10-22 12:24:09 [DEBUG   ] Finished updating board flags in 1.564 seconds
2018-10-22 12:24:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-10-22 12:24:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-10-22 12:24:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
