2018-12-14 13:25:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:25:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 13:25:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:25:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:25:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:25:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:25:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:25:12 [DEBUG   ] Finished updating board flags in 2.161 seconds
2018-12-14 13:25:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 13:25:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 13:25:54 [DEBUG   ] Got command RPT from MCS: ref #835860
2018-12-14 13:25:54 [DEBUG   ] summary = ERROR
2018-12-14 13:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835860  13 58466 48354609 A  ERRORERROR'
2018-12-14 13:25:54 [DEBUG   ] Got command RPT from MCS: ref #835861
2018-12-14 13:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835861  77 58466 48354610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:25:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 13:26:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 13:26:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:26:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:26:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:26:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:26:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:26:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:26:12 [DEBUG   ] Finished updating board flags in 1.975 seconds
2018-12-14 13:26:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 13:26:37 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-12-14 13:26:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 13:27:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:27:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:27:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:27:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:27:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:27:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:27:12 [DEBUG   ] Finished updating board flags in 1.775 seconds
2018-12-14 13:27:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 13:27:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 13:27:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 13:28:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:28:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:28:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:28:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:28:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:28:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:28:12 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-14 13:28:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 13:28:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 13:28:58 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-14 13:29:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:29:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:29:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:29:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:29:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:29:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:29:12 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-12-14 13:29:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 13:29:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 13:29:56 [DEBUG   ] Got command RPT from MCS: ref #835887
2018-12-14 13:29:56 [DEBUG   ] summary = ERROR
2018-12-14 13:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835887  13 58466 48596977 A  ERRORERROR'
2018-12-14 13:29:57 [DEBUG   ] Got command RPT from MCS: ref #835888
2018-12-14 13:29:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835888  77 58466 48597181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:29:57 [DEBUG   ] Got command RPT from MCS: ref #835889
2018-12-14 13:29:57 [DEBUG   ] summary = ERROR
2018-12-14 13:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835889  13 58466 48597374 A  ERRORERROR'
2018-12-14 13:29:57 [DEBUG   ] Got command RPT from MCS: ref #835891
2018-12-14 13:29:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835891  77 58466 48597577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:29:57 [DEBUG   ] Got command RPT from MCS: ref #835892
2018-12-14 13:29:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 13:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835892  12 58466 48597781 A  ERRORB—™š'
2018-12-14 13:29:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 13:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:30:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:30:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:30:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:30:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:30:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:30:12 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-12-14 13:30:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 13:30:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 13:30:54 [DEBUG   ] Got command RPT from MCS: ref #835897
2018-12-14 13:30:54 [DEBUG   ] summary = ERROR
2018-12-14 13:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835897  13 58466 48654605 A  ERRORERROR'
2018-12-14 13:30:54 [DEBUG   ] Got command RPT from MCS: ref #835898
2018-12-14 13:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835898  77 58466 48654606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:30:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 13:31:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:31:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:31:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:31:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:31:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:31:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:31:12 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-14 13:31:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 13:31:38 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-14 13:31:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 13:32:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:32:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:32:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:32:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:32:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:32:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:32:12 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-12-14 13:32:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 13:32:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 13:32:58 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-14 13:33:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:33:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 13:33:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:33:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:33:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:33:12 [WARNING ] (13, 1, 'bot')
2018-12-14 13:33:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:33:12 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-12-14 13:33:19 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 13:33:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 13:33:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 13:34:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:34:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:34:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:34:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:34:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:34:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:34:13 [DEBUG   ] Finished updating board flags in 2.051 seconds
2018-12-14 13:34:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 13:34:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 13:34:57 [DEBUG   ] Got command RPT from MCS: ref #835918
2018-12-14 13:34:57 [DEBUG   ] summary = ERROR
2018-12-14 13:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835918  13 58466 48897053 A  ERRORERROR'
2018-12-14 13:34:57 [DEBUG   ] Got command RPT from MCS: ref #835919
2018-12-14 13:34:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835919  77 58466 48897257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:34:57 [DEBUG   ] Got command RPT from MCS: ref #835920
2018-12-14 13:34:57 [DEBUG   ] summary = ERROR
2018-12-14 13:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835920  13 58466 48897461 A  ERRORERROR'
2018-12-14 13:34:57 [DEBUG   ] Got command RPT from MCS: ref #835921
2018-12-14 13:34:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835921  77 58466 48897665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:34:57 [DEBUG   ] Got command RPT from MCS: ref #835922
2018-12-14 13:34:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 13:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835922  12 58466 48897857 A  ERRORB–™š'
2018-12-14 13:34:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 13:35:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:35:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:35:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:35:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:35:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:35:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:35:13 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-12-14 13:35:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 13:35:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 13:35:54 [DEBUG   ] Got command RPT from MCS: ref #835927
2018-12-14 13:35:54 [DEBUG   ] summary = ERROR
2018-12-14 13:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835927  13 58466 48954605 A  ERRORERROR'
2018-12-14 13:35:54 [DEBUG   ] Got command RPT from MCS: ref #835928
2018-12-14 13:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835928  77 58466 48954606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:35:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 13:36:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:36:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:36:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:36:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:36:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:36:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:36:13 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-12-14 13:36:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 13:36:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 13:36:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 13:37:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:37:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 13:37:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:37:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:37:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:37:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:37:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:37:13 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-14 13:37:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 13:37:39 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 13:37:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 13:38:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:38:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 13:38:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:38:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:38:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:38:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:38:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:38:13 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-12-14 13:38:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 13:38:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 13:38:59 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 13:39:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-14 13:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:39:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:39:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:39:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:39:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:39:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:39:13 [DEBUG   ] Finished updating board flags in 1.645 seconds
2018-12-14 13:39:19 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-14 13:39:40 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-14 13:39:57 [DEBUG   ] Got command RPT from MCS: ref #835950
2018-12-14 13:39:57 [DEBUG   ] summary = ERROR
2018-12-14 13:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835950  13 58466 49197133 A  ERRORERROR'
2018-12-14 13:39:57 [DEBUG   ] Got command RPT from MCS: ref #835951
2018-12-14 13:39:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835951  77 58466 49197337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:39:57 [DEBUG   ] Got command RPT from MCS: ref #835952
2018-12-14 13:39:57 [DEBUG   ] summary = ERROR
2018-12-14 13:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835952  13 58466 49197541 A  ERRORERROR'
2018-12-14 13:39:57 [DEBUG   ] Got command RPT from MCS: ref #835954
2018-12-14 13:39:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835954  77 58466 49197745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:39:57 [DEBUG   ] Got command RPT from MCS: ref #835956
2018-12-14 13:39:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 13:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835956  12 58466 49197937 A  ERRORB—™š'
2018-12-14 13:40:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 13:40:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:40:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:40:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:40:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:40:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:40:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:40:13 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-12-14 13:40:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 13:40:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 13:40:54 [DEBUG   ] Got command RPT from MCS: ref #835960
2018-12-14 13:40:54 [DEBUG   ] summary = ERROR
2018-12-14 13:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835960  13 58466 49254605 A  ERRORERROR'
2018-12-14 13:40:54 [DEBUG   ] Got command RPT from MCS: ref #835961
2018-12-14 13:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835961  77 58466 49254606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:41:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 13:41:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:41:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:41:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:41:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:41:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:41:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:41:13 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-12-14 13:41:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 13:41:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 13:42:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 13:42:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:42:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:42:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:42:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:42:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:42:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:42:13 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-12-14 13:42:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 13:42:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 13:43:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 13:43:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:43:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:43:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:43:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:43:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:43:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:43:13 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-12-14 13:43:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 13:43:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 13:44:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 13:44:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:44:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 13:44:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:44:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:44:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:44:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:44:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:44:13 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-12-14 13:44:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 13:44:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 13:44:57 [DEBUG   ] Got command RPT from MCS: ref #835985
2018-12-14 13:44:57 [DEBUG   ] summary = ERROR
2018-12-14 13:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835985  13 58466 49497217 A  ERRORERROR'
2018-12-14 13:44:57 [DEBUG   ] Got command RPT from MCS: ref #835986
2018-12-14 13:44:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835986  77 58466 49497421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:44:57 [DEBUG   ] Got command RPT from MCS: ref #835987
2018-12-14 13:44:57 [DEBUG   ] summary = ERROR
2018-12-14 13:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835987  13 58466 49497625 A  ERRORERROR'
2018-12-14 13:44:57 [DEBUG   ] Got command RPT from MCS: ref #835988
2018-12-14 13:44:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835988  77 58466 49497817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:44:58 [DEBUG   ] Got command RPT from MCS: ref #835989
2018-12-14 13:44:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 13:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835989  12 58466 49498021 A  ERRORB—™š'
2018-12-14 13:45:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 13:45:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:45:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:45:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:45:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:45:13 [WARNING ] (13, 1, 'bot')
2018-12-14 13:45:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:45:13 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-12-14 13:45:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 13:45:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 13:45:54 [DEBUG   ] Got command RPT from MCS: ref #835990
2018-12-14 13:45:54 [DEBUG   ] summary = ERROR
2018-12-14 13:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835990  13 58466 49554613 A  ERRORERROR'
2018-12-14 13:45:54 [DEBUG   ] Got command RPT from MCS: ref #835991
2018-12-14 13:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   835991  77 58466 49554614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:46:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 13:46:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:46:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:46:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:46:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:46:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:46:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:46:14 [DEBUG   ] Finished updating board flags in 2.234 seconds
2018-12-14 13:46:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 13:46:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 13:47:01 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 13:47:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:47:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:47:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:47:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:47:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:47:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:47:14 [DEBUG   ] Finished updating board flags in 2.154 seconds
2018-12-14 13:47:21 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 13:47:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 13:48:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 13:48:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:48:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:48:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:48:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:48:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:48:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:48:14 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-12-14 13:48:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 13:48:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 13:49:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 13:49:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:49:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:49:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:49:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:49:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:49:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:49:14 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-12-14 13:49:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 13:49:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 13:49:57 [DEBUG   ] Got command RPT from MCS: ref #836013
2018-12-14 13:49:57 [DEBUG   ] summary = ERROR
2018-12-14 13:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836013  13 58466 49797305 A  ERRORERROR'
2018-12-14 13:49:57 [DEBUG   ] Got command RPT from MCS: ref #836014
2018-12-14 13:49:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836014  77 58466 49797497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:49:57 [DEBUG   ] Got command RPT from MCS: ref #836015
2018-12-14 13:49:57 [DEBUG   ] summary = ERROR
2018-12-14 13:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836015  13 58466 49797701 A  ERRORERROR'
2018-12-14 13:49:57 [DEBUG   ] Got command RPT from MCS: ref #836017
2018-12-14 13:49:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836017  77 58466 49797905 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:49:58 [DEBUG   ] Got command RPT from MCS: ref #836018
2018-12-14 13:49:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 13:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836018  12 58466 49798097 A  ERRORB–™š'
2018-12-14 13:50:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 13:50:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:50:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 13:50:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:50:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:50:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:50:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:50:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:50:14 [DEBUG   ] Finished updating board flags in 2.075 seconds
2018-12-14 13:50:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 13:50:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 13:50:54 [DEBUG   ] Got command RPT from MCS: ref #836027
2018-12-14 13:50:54 [DEBUG   ] summary = ERROR
2018-12-14 13:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836027  13 58466 49854609 A  ERRORERROR'
2018-12-14 13:50:54 [DEBUG   ] Got command RPT from MCS: ref #836028
2018-12-14 13:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836028  77 58466 49854610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:51:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 13:51:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:51:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:51:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:51:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:51:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:51:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:51:14 [DEBUG   ] Finished updating board flags in 1.901 seconds
2018-12-14 13:51:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 13:51:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 13:52:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 13:52:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:52:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:52:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:52:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:52:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:52:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:52:14 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-14 13:52:22 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-14 13:52:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 13:53:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 13:53:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:53:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:53:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:53:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:53:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:53:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:53:14 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-14 13:53:22 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-14 13:53:42 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 13:54:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 13:54:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:54:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:54:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:54:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:54:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:54:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:54:14 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-14 13:54:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 13:54:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 13:54:57 [DEBUG   ] Got command RPT from MCS: ref #836048
2018-12-14 13:54:57 [DEBUG   ] summary = ERROR
2018-12-14 13:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836048  13 58466 50097385 A  ERRORERROR'
2018-12-14 13:54:57 [DEBUG   ] Got command RPT from MCS: ref #836049
2018-12-14 13:54:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836049  77 58466 50097577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:54:57 [DEBUG   ] Got command RPT from MCS: ref #836050
2018-12-14 13:54:57 [DEBUG   ] summary = ERROR
2018-12-14 13:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836050  13 58466 50097781 A  ERRORERROR'
2018-12-14 13:54:57 [DEBUG   ] Got command RPT from MCS: ref #836051
2018-12-14 13:54:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836051  77 58466 50097985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:54:58 [DEBUG   ] Got command RPT from MCS: ref #836052
2018-12-14 13:54:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 13:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836052  12 58466 50098189 A  ERRORB•™š'
2018-12-14 13:55:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 13:55:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:55:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:55:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:55:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:55:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:55:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:55:14 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-14 13:55:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 13:55:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 13:55:54 [DEBUG   ] Got command RPT from MCS: ref #836053
2018-12-14 13:55:54 [DEBUG   ] summary = ERROR
2018-12-14 13:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836053  13 58466 50154609 A  ERRORERROR'
2018-12-14 13:55:54 [DEBUG   ] Got command RPT from MCS: ref #836054
2018-12-14 13:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836054  77 58466 50154610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:56:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 13:56:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:56:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:56:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:56:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:56:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:56:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:56:14 [DEBUG   ] Finished updating board flags in 1.692 seconds
2018-12-14 13:56:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 13:56:42 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-14 13:57:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 13:57:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:57:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:57:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:57:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:57:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:57:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:57:14 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-12-14 13:57:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 13:57:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 13:58:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 13:58:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 13:58:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:58:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:58:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:58:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:58:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:58:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:58:14 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-12-14 13:58:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 13:58:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 13:59:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 13:59:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 13:59:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 13:59:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:59:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:59:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:59:14 [WARNING ] (13, 1, 'bot')
2018-12-14 13:59:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 13:59:14 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-12-14 13:59:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 13:59:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 13:59:57 [DEBUG   ] Got command RPT from MCS: ref #836080
2018-12-14 13:59:57 [DEBUG   ] summary = ERROR
2018-12-14 13:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836080  13 58466 50397462 A  ERRORERROR'
2018-12-14 13:59:57 [DEBUG   ] Got command RPT from MCS: ref #836081
2018-12-14 13:59:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836081  77 58466 50397665 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:59:57 [DEBUG   ] Got command RPT from MCS: ref #836082
2018-12-14 13:59:57 [DEBUG   ] summary = ERROR
2018-12-14 13:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836082  13 58466 50397869 A  ERRORERROR'
2018-12-14 13:59:58 [DEBUG   ] Got command RPT from MCS: ref #836084
2018-12-14 13:59:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 13:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836084  77 58466 50398062 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 13:59:58 [DEBUG   ] Got command RPT from MCS: ref #836085
2018-12-14 13:59:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 13:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836085  12 58466 50398265 A  ERRORB—™š'
2018-12-14 14:00:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 14:00:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:00:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:00:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:00:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:00:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:00:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:00:14 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-14 14:00:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 14:00:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 14:00:54 [DEBUG   ] Got command RPT from MCS: ref #836090
2018-12-14 14:00:54 [DEBUG   ] summary = ERROR
2018-12-14 14:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836090  13 58466 50454613 A  ERRORERROR'
2018-12-14 14:00:54 [DEBUG   ] Got command RPT from MCS: ref #836091
2018-12-14 14:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836091  77 58466 50454614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:01:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 14:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 14:01:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:01:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 14:01:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:01:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:01:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:01:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:01:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:01:14 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-14 14:01:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 14:01:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 14:02:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 14:02:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:02:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:02:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:02:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:02:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:02:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:02:14 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-12-14 14:02:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 14:02:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 14:03:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 14:03:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:03:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:03:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:03:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:03:14 [WARNING ] (13, 1, 'bot')
2018-12-14 14:03:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:03:14 [DEBUG   ] Finished updating board flags in 1.564 seconds
2018-12-14 14:03:23 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-12-14 14:03:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 14:04:03 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-12-14 14:04:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:04:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:04:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:04:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:04:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:04:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:04:15 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-12-14 14:04:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 14:04:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 14:04:57 [DEBUG   ] Got command RPT from MCS: ref #836111
2018-12-14 14:04:57 [DEBUG   ] summary = ERROR
2018-12-14 14:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836111  13 58466 50697541 A  ERRORERROR'
2018-12-14 14:04:57 [DEBUG   ] Got command RPT from MCS: ref #836112
2018-12-14 14:04:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836112  77 58466 50697745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:04:57 [DEBUG   ] Got command RPT from MCS: ref #836113
2018-12-14 14:04:57 [DEBUG   ] summary = ERROR
2018-12-14 14:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836113  13 58466 50697949 A  ERRORERROR'
2018-12-14 14:04:58 [DEBUG   ] Got command RPT from MCS: ref #836114
2018-12-14 14:04:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836114  77 58466 50698141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:04:58 [DEBUG   ] Got command RPT from MCS: ref #836115
2018-12-14 14:04:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836115  12 58466 50698345 A  ERRORB—™š'
2018-12-14 14:05:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 14:05:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 14:05:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:05:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:05:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:05:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:05:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:05:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:05:15 [DEBUG   ] Finished updating board flags in 2.133 seconds
2018-12-14 14:05:23 [DEBUG   ] Finished updating ant stats in 0.791 seconds
2018-12-14 14:05:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 14:05:54 [DEBUG   ] Got command RPT from MCS: ref #836120
2018-12-14 14:05:54 [DEBUG   ] summary = ERROR
2018-12-14 14:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836120  13 58466 50754617 A  ERRORERROR'
2018-12-14 14:05:54 [DEBUG   ] Got command RPT from MCS: ref #836121
2018-12-14 14:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836121  77 58466 50754618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:06:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:06:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:06:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:06:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:06:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:06:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:06:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:06:15 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-12-14 14:06:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 14:06:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 14:07:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:07:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:07:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:07:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:07:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:07:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:07:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:07:15 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-12-14 14:07:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:07:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 14:08:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:08:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:08:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:08:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:08:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:08:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:08:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:08:15 [DEBUG   ] Finished updating board flags in 1.850 seconds
2018-12-14 14:08:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 14:08:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:09:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 14:09:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:09:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:09:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:09:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:09:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:09:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:09:15 [DEBUG   ] Finished updating board flags in 1.747 seconds
2018-12-14 14:09:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 14:09:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-14 14:09:57 [DEBUG   ] Got command RPT from MCS: ref #836143
2018-12-14 14:09:57 [DEBUG   ] summary = ERROR
2018-12-14 14:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836143  13 58466 50997621 A  ERRORERROR'
2018-12-14 14:09:57 [DEBUG   ] Got command RPT from MCS: ref #836144
2018-12-14 14:09:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836144  77 58466 50997825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:09:58 [DEBUG   ] Got command RPT from MCS: ref #836145
2018-12-14 14:09:58 [DEBUG   ] summary = ERROR
2018-12-14 14:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836145  13 58466 50998029 A  ERRORERROR'
2018-12-14 14:09:58 [DEBUG   ] Got command RPT from MCS: ref #836147
2018-12-14 14:09:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836147  77 58466 50998221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:09:58 [DEBUG   ] Got command RPT from MCS: ref #836148
2018-12-14 14:09:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836148  12 58466 50998425 A  ERRORB–™š'
2018-12-14 14:10:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 14:10:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:10:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:10:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:10:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:10:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:10:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:10:15 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-12-14 14:10:24 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 14:10:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 14:10:54 [DEBUG   ] Got command RPT from MCS: ref #836153
2018-12-14 14:10:54 [DEBUG   ] summary = ERROR
2018-12-14 14:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836153  13 58466 51054617 A  ERRORERROR'
2018-12-14 14:10:54 [DEBUG   ] Got command RPT from MCS: ref #836154
2018-12-14 14:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836154  77 58466 51054618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:11:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 14:11:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:11:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:11:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:11:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:11:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:11:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:11:15 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-12-14 14:11:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 14:11:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 14:12:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 14:12:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:12:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:12:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:12:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:12:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:12:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:12:15 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-12-14 14:12:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 14:12:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 14:13:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 14:13:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:13:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:13:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:13:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:13:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:13:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:13:15 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-12-14 14:13:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:13:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 14:14:00 [DEBUG   ] Got command TBN from MCS: ref #836174
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-12-14 14:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   836174   8 58466 51240682 A  ERROR'
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1544796842']
2018-12-14 14:14:00 [DEBUG   ] spawn_process: at 2018-12-14 14:14:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1544796842']
2018-12-14 14:14:00 [INFO    ] Finished spawning TBN in 0.054 s
2018-12-14 14:14:04 [DEBUG   ] Finished updating ant stats in 0.537 seconds
2018-12-14 14:14:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:14:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:14:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:14:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:14:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:14:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:14:15 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-12-14 14:14:24 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2018-12-14 14:14:45 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 14:14:57 [DEBUG   ] Got command RPT from MCS: ref #836179
2018-12-14 14:14:57 [DEBUG   ] summary = ERROR
2018-12-14 14:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836179  13 58466 51297705 A  ERRORERROR'
2018-12-14 14:14:57 [DEBUG   ] Got command RPT from MCS: ref #836180
2018-12-14 14:14:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836180  77 58466 51297909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:14:58 [DEBUG   ] Got command RPT from MCS: ref #836181
2018-12-14 14:14:58 [DEBUG   ] summary = ERROR
2018-12-14 14:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836181  13 58466 51298101 A  ERRORERROR'
2018-12-14 14:14:58 [DEBUG   ] Got command RPT from MCS: ref #836182
2018-12-14 14:14:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836182  77 58466 51298305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:14:58 [DEBUG   ] Got command RPT from MCS: ref #836183
2018-12-14 14:14:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836183  12 58466 51298509 A  ERRORB•™š'
2018-12-14 14:15:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 14:15:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:15:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:15:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:15:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:15:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:15:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:15:15 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-12-14 14:15:25 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-12-14 14:15:45 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 14:15:54 [DEBUG   ] Got command RPT from MCS: ref #836184
2018-12-14 14:15:54 [DEBUG   ] summary = ERROR
2018-12-14 14:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836184  13 58466 51354617 A  ERRORERROR'
2018-12-14 14:15:54 [DEBUG   ] Got command RPT from MCS: ref #836185
2018-12-14 14:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836185  77 58466 51354618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:16:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 14:16:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:16:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:16:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:16:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:16:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:16:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:16:15 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-12-14 14:16:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 14:16:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 14:17:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 14:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-14 14:17:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:17:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:17:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:17:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:17:15 [WARNING ] (13, 1, 'bot')
2018-12-14 14:17:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:17:15 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-12-14 14:17:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 14:17:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:18:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:18:11 [DEBUG   ] Got command TBW from MCS: ref #836206
2018-12-14 14:18:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-12-14 14:18:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   836206   8 58466 51491754 A  ERROR'
2018-12-14 14:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-12-14 14:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-12-14 14:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-12-14 14:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-12-14 14:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-12-14 14:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-12-14 14:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-12-14 14:18:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-12-14 14:18:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-12-14 14:18:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-12-14 14:18:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-12-14 14:18:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-12-14 14:18:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-12-14 14:18:15 [DEBUG   ] spawn_process: at 2018-12-14 14:18:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-12-14 14:18:15 [INFO    ] Finished spawning TBW
2018-12-14 14:18:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:18:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 14:18:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:18:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:18:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:18:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:18:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:18:16 [DEBUG   ] Finished updating board flags in 1.884 seconds
2018-12-14 14:19:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:19:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:19:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:19:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:19:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:19:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:19:16 [DEBUG   ] Finished updating board flags in 1.940 seconds
2018-12-14 14:19:57 [DEBUG   ] Got command RPT from MCS: ref #836213
2018-12-14 14:19:57 [DEBUG   ] summary = ERROR
2018-12-14 14:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836213  13 58466 51597789 A  ERRORERROR'
2018-12-14 14:19:57 [DEBUG   ] Got command RPT from MCS: ref #836214
2018-12-14 14:19:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836214  77 58466 51597981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:19:58 [DEBUG   ] Got command RPT from MCS: ref #836215
2018-12-14 14:19:58 [DEBUG   ] summary = ERROR
2018-12-14 14:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836215  13 58466 51598185 A  ERRORERROR'
2018-12-14 14:19:58 [DEBUG   ] Got command RPT from MCS: ref #836217
2018-12-14 14:19:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836217  77 58466 51598389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:19:58 [DEBUG   ] Got command RPT from MCS: ref #836218
2018-12-14 14:19:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836218  12 58466 51598593 A  ERRORB—™š'
2018-12-14 14:20:03 [INFO    ] __waitForTBW - TBW finished in 108.423 s
2018-12-14 14:20:04 [DEBUG   ] Finished updating ant stats in 0.568 seconds
2018-12-14 14:20:04 [INFO    ] Started antennas statistics background thread
2018-12-14 14:20:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1544797206']
2018-12-14 14:20:04 [DEBUG   ] spawn_process: at 2018-12-14 14:20:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1544797206']
2018-12-14 14:20:04 [INFO    ] Finished spawning TBN in 0.049 s
2018-12-14 14:20:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:20:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 14:20:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:20:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:20:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:20:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:20:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:20:16 [DEBUG   ] Finished updating board flags in 1.972 seconds
2018-12-14 14:20:24 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2018-12-14 14:20:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 14:20:54 [DEBUG   ] Got command RPT from MCS: ref #836230
2018-12-14 14:20:54 [DEBUG   ] summary = ERROR
2018-12-14 14:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836230  13 58466 51654613 A  ERRORERROR'
2018-12-14 14:20:54 [DEBUG   ] Got command RPT from MCS: ref #836231
2018-12-14 14:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836231  77 58466 51654614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:21:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 14:21:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:21:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-14 14:21:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:21:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:21:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:21:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:21:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:21:16 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-14 14:21:24 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-12-14 14:21:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 14:22:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 14:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 14:22:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:22:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:22:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:22:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:22:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:22:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:22:16 [DEBUG   ] Finished updating board flags in 1.653 seconds
2018-12-14 14:22:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 14:22:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 14:23:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 14:23:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:23:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 14:23:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:23:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:23:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:23:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:23:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:23:16 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-12-14 14:23:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 14:23:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 14:24:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 14:24:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:24:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:24:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:24:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:24:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:24:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:24:16 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-12-14 14:24:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 14:24:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 14:24:57 [DEBUG   ] Got command RPT from MCS: ref #836251
2018-12-14 14:24:57 [DEBUG   ] summary = ERROR
2018-12-14 14:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836251  13 58466 51897869 A  ERRORERROR'
2018-12-14 14:24:58 [DEBUG   ] Got command RPT from MCS: ref #836252
2018-12-14 14:24:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836252  77 58466 51898073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:24:58 [DEBUG   ] Got command RPT from MCS: ref #836253
2018-12-14 14:24:58 [DEBUG   ] summary = ERROR
2018-12-14 14:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836253  13 58466 51898265 A  ERRORERROR'
2018-12-14 14:24:58 [DEBUG   ] Got command RPT from MCS: ref #836254
2018-12-14 14:24:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836254  77 58466 51898469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:24:58 [DEBUG   ] Got command RPT from MCS: ref #836255
2018-12-14 14:24:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836255  12 58466 51898673 A  ERRORB˜™š'
2018-12-14 14:25:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 14:25:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:25:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:25:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:25:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:25:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:25:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:25:16 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-14 14:25:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 14:25:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 14:25:54 [DEBUG   ] Got command RPT from MCS: ref #836256
2018-12-14 14:25:54 [DEBUG   ] summary = ERROR
2018-12-14 14:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836256  13 58466 51954617 A  ERRORERROR'
2018-12-14 14:25:54 [DEBUG   ] Got command RPT from MCS: ref #836257
2018-12-14 14:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836257  77 58466 51954618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:26:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 14:26:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:26:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:26:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:26:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:26:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:26:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:26:16 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-12-14 14:26:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 14:26:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:27:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:27:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:27:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:27:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:27:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:27:16 [WARNING ] (13, 1, 'bot')
2018-12-14 14:27:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:27:16 [DEBUG   ] Finished updating board flags in 1.365 seconds
2018-12-14 14:27:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 14:27:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 14:28:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:28:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:28:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:28:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:28:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:28:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:28:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:28:17 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-12-14 14:28:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:28:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 14:29:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 14:29:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:29:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:29:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:29:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:29:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:29:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:29:17 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-12-14 14:29:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 14:29:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 14:29:57 [DEBUG   ] Got command RPT from MCS: ref #836283
2018-12-14 14:29:57 [DEBUG   ] summary = ERROR
2018-12-14 14:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836283  13 58466 52197949 A  ERRORERROR'
2018-12-14 14:29:58 [DEBUG   ] Got command RPT from MCS: ref #836284
2018-12-14 14:29:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836284  77 58466 52198153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:29:58 [DEBUG   ] Got command RPT from MCS: ref #836285
2018-12-14 14:29:58 [DEBUG   ] summary = ERROR
2018-12-14 14:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836285  13 58466 52198345 A  ERRORERROR'
2018-12-14 14:29:58 [DEBUG   ] Got command RPT from MCS: ref #836287
2018-12-14 14:29:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836287  77 58466 52198549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:29:58 [DEBUG   ] Got command RPT from MCS: ref #836288
2018-12-14 14:29:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836288  12 58466 52198753 A  ERRORB—™š'
2018-12-14 14:30:06 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 14:30:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:30:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:30:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:30:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:30:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:30:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:30:17 [DEBUG   ] Finished updating board flags in 1.960 seconds
2018-12-14 14:30:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 14:30:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 14:30:54 [DEBUG   ] Got command RPT from MCS: ref #836293
2018-12-14 14:30:54 [DEBUG   ] summary = ERROR
2018-12-14 14:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836293  13 58466 52254617 A  ERRORERROR'
2018-12-14 14:30:54 [DEBUG   ] Got command RPT from MCS: ref #836294
2018-12-14 14:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836294  77 58466 52254618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:31:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 14:31:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:31:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:31:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:31:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:31:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:31:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:31:17 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-14 14:31:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 14:31:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 14:32:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 14:32:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:32:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:32:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:32:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:32:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:32:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:32:17 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-12-14 14:32:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 14:32:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 14:33:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 14:33:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:33:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 14:33:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:33:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:33:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:33:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:33:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:33:17 [DEBUG   ] Finished updating board flags in 1.637 seconds
2018-12-14 14:33:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 14:33:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 14:34:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 14:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 14:34:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:34:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:34:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:34:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:34:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:34:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:34:17 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-12-14 14:34:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 14:34:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 14:34:58 [DEBUG   ] Got command RPT from MCS: ref #836319
2018-12-14 14:34:58 [DEBUG   ] summary = ERROR
2018-12-14 14:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836319  13 58466 52498029 A  ERRORERROR'
2018-12-14 14:34:58 [DEBUG   ] Got command RPT from MCS: ref #836320
2018-12-14 14:34:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836320  77 58466 52498233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:34:58 [DEBUG   ] Got command RPT from MCS: ref #836321
2018-12-14 14:34:58 [DEBUG   ] summary = ERROR
2018-12-14 14:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836321  13 58466 52498425 A  ERRORERROR'
2018-12-14 14:34:58 [DEBUG   ] Got command RPT from MCS: ref #836322
2018-12-14 14:34:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836322  77 58466 52498629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:34:58 [DEBUG   ] Got command RPT from MCS: ref #836323
2018-12-14 14:34:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836323  12 58466 52498833 A  ERRORB—™š'
2018-12-14 14:35:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 14:35:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:35:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 14:35:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:35:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:35:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:35:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:35:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:35:17 [DEBUG   ] Finished updating board flags in 1.642 seconds
2018-12-14 14:35:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 14:35:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 14:35:54 [DEBUG   ] Got command RPT from MCS: ref #836333
2018-12-14 14:35:54 [DEBUG   ] summary = ERROR
2018-12-14 14:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836333  13 58466 52554625 A  ERRORERROR'
2018-12-14 14:35:54 [DEBUG   ] Got command RPT from MCS: ref #836334
2018-12-14 14:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836334  77 58466 52554626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:36:07 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-12-14 14:36:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:36:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:36:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:36:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:36:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:36:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:36:17 [DEBUG   ] Finished updating board flags in 1.524 seconds
2018-12-14 14:36:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 14:36:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 14:37:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 14:37:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:37:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:37:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:37:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:37:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:37:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:37:17 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-12-14 14:37:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 14:37:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 14:38:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 14:38:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:38:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:38:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:38:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:38:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:38:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:38:17 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-12-14 14:38:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 14:38:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 14:39:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 14:39:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:39:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:39:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:39:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:39:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:39:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:39:17 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-12-14 14:39:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:39:47 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 14:39:58 [DEBUG   ] Got command RPT from MCS: ref #836356
2018-12-14 14:39:58 [DEBUG   ] summary = ERROR
2018-12-14 14:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836356  13 58466 52798113 A  ERRORERROR'
2018-12-14 14:39:58 [DEBUG   ] Got command RPT from MCS: ref #836357
2018-12-14 14:39:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836357  77 58466 52798305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:39:58 [DEBUG   ] Got command RPT from MCS: ref #836358
2018-12-14 14:39:58 [DEBUG   ] summary = ERROR
2018-12-14 14:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836358  13 58466 52798509 A  ERRORERROR'
2018-12-14 14:39:58 [DEBUG   ] Got command RPT from MCS: ref #836360
2018-12-14 14:39:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836360  77 58466 52798713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:39:58 [DEBUG   ] Got command RPT from MCS: ref #836361
2018-12-14 14:39:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836361  12 58466 52798917 A  ERRORB–™š'
2018-12-14 14:40:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 14:40:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:40:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:40:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:40:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:40:17 [WARNING ] (13, 1, 'bot')
2018-12-14 14:40:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:40:17 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-12-14 14:40:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 14:40:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 14:40:54 [DEBUG   ] Got command RPT from MCS: ref #836366
2018-12-14 14:40:54 [DEBUG   ] summary = ERROR
2018-12-14 14:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836366  13 58466 52854617 A  ERRORERROR'
2018-12-14 14:40:54 [DEBUG   ] Got command RPT from MCS: ref #836367
2018-12-14 14:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836367  77 58466 52854618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:41:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 14:41:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:41:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 14:41:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:41:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:41:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:41:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:41:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:41:18 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-12-14 14:41:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 14:41:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 14:42:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 14:42:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:42:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:42:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:42:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:42:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:42:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:42:18 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-12-14 14:42:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 14:42:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 14:43:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 14:43:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:43:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:43:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:43:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:43:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:43:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:43:18 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-14 14:43:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 14:43:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 14:44:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 14:44:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:44:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:44:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:44:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:44:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:44:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:44:18 [DEBUG   ] Finished updating board flags in 1.834 seconds
2018-12-14 14:44:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 14:44:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 14:44:58 [DEBUG   ] Got command RPT from MCS: ref #836391
2018-12-14 14:44:58 [DEBUG   ] summary = ERROR
2018-12-14 14:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836391  13 58466 53098185 A  ERRORERROR'
2018-12-14 14:44:58 [DEBUG   ] Got command RPT from MCS: ref #836392
2018-12-14 14:44:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836392  77 58466 53098389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:44:58 [DEBUG   ] Got command RPT from MCS: ref #836393
2018-12-14 14:44:58 [DEBUG   ] summary = ERROR
2018-12-14 14:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836393  13 58466 53098593 A  ERRORERROR'
2018-12-14 14:44:58 [DEBUG   ] Got command RPT from MCS: ref #836394
2018-12-14 14:44:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836394  77 58466 53098797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:44:58 [DEBUG   ] Got command RPT from MCS: ref #836395
2018-12-14 14:44:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836395  12 58466 53098989 A  ERRORB–™š'
2018-12-14 14:45:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 14:45:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:45:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:45:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:45:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:45:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:45:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:45:18 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-12-14 14:45:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 14:45:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 14:45:54 [DEBUG   ] Got command RPT from MCS: ref #836396
2018-12-14 14:45:54 [DEBUG   ] summary = ERROR
2018-12-14 14:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836396  13 58466 53154625 A  ERRORERROR'
2018-12-14 14:45:54 [DEBUG   ] Got command RPT from MCS: ref #836397
2018-12-14 14:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836397  77 58466 53154626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:46:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 14:46:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:46:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:46:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:46:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:46:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:46:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:46:18 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-12-14 14:46:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 14:46:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 14:47:09 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 14:47:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:47:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:47:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:47:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:47:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:47:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:47:18 [DEBUG   ] Finished updating board flags in 1.555 seconds
2018-12-14 14:47:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 14:47:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 14:48:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 14:48:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:48:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:48:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:48:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:48:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:48:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:48:18 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-14 14:48:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 14:48:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 14:49:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 14:49:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:49:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:49:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:49:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:49:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:49:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:49:18 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-12-14 14:49:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 14:49:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 14:49:58 [DEBUG   ] Got command RPT from MCS: ref #836419
2018-12-14 14:49:58 [DEBUG   ] summary = ERROR
2018-12-14 14:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836419  13 58466 53398269 A  ERRORERROR'
2018-12-14 14:49:58 [DEBUG   ] Got command RPT from MCS: ref #836420
2018-12-14 14:49:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836420  77 58466 53398461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:49:58 [DEBUG   ] Got command RPT from MCS: ref #836421
2018-12-14 14:49:58 [DEBUG   ] summary = ERROR
2018-12-14 14:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836421  13 58466 53398665 A  ERRORERROR'
2018-12-14 14:49:58 [DEBUG   ] Got command RPT from MCS: ref #836423
2018-12-14 14:49:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836423  77 58466 53398869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:49:59 [DEBUG   ] Got command RPT from MCS: ref #836424
2018-12-14 14:49:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836424  12 58466 53399073 A  ERRORB•™š'
2018-12-14 14:50:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 14:50:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:50:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 14:50:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:50:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:50:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:50:18 [WARNING ] (13, 1, 'bot')
2018-12-14 14:50:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:50:18 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-14 14:50:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:50:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 14:50:54 [DEBUG   ] Got command RPT from MCS: ref #836433
2018-12-14 14:50:54 [DEBUG   ] summary = ERROR
2018-12-14 14:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836433  13 58466 53454621 A  ERRORERROR'
2018-12-14 14:50:54 [DEBUG   ] Got command RPT from MCS: ref #836434
2018-12-14 14:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836434  77 58466 53454622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:51:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 14:51:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:51:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:51:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:51:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:51:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:51:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:51:19 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-12-14 14:51:29 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-12-14 14:51:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 14:52:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 14:52:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:52:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:52:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:52:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:52:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:52:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:52:19 [DEBUG   ] Finished updating board flags in 2.177 seconds
2018-12-14 14:52:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 14:52:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 14:53:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 14:53:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:53:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:53:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:53:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:53:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:53:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:53:19 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-12-14 14:53:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 14:53:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 14:54:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 14:54:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 14:54:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:54:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:54:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:54:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:54:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:54:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:54:19 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-12-14 14:54:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 14:54:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 14:54:58 [DEBUG   ] Got command RPT from MCS: ref #836454
2018-12-14 14:54:58 [DEBUG   ] summary = ERROR
2018-12-14 14:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836454  13 58466 53698349 A  ERRORERROR'
2018-12-14 14:54:58 [DEBUG   ] Got command RPT from MCS: ref #836455
2018-12-14 14:54:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836455  77 58466 53698541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:54:58 [DEBUG   ] Got command RPT from MCS: ref #836456
2018-12-14 14:54:58 [DEBUG   ] summary = ERROR
2018-12-14 14:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836456  13 58466 53698745 A  ERRORERROR'
2018-12-14 14:54:58 [DEBUG   ] Got command RPT from MCS: ref #836457
2018-12-14 14:54:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836457  77 58466 53698949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:54:59 [DEBUG   ] Got command RPT from MCS: ref #836458
2018-12-14 14:54:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836458  12 58466 53699153 A  ERRORB–™š'
2018-12-14 14:55:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 14:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 14:55:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:55:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:55:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:55:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:55:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:55:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:55:19 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-12-14 14:55:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 14:55:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 14:55:54 [DEBUG   ] Got command RPT from MCS: ref #836459
2018-12-14 14:55:54 [DEBUG   ] summary = ERROR
2018-12-14 14:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836459  13 58466 53754621 A  ERRORERROR'
2018-12-14 14:55:54 [DEBUG   ] Got command RPT from MCS: ref #836460
2018-12-14 14:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836460  77 58466 53754622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:56:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 14:56:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:56:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:56:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:56:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:56:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:56:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:56:19 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-12-14 14:56:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 14:56:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 14:57:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 14:57:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:57:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:57:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:57:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:57:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:57:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:57:19 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-12-14 14:57:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 14:57:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 14:58:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 14:58:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:58:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:58:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:58:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:58:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:58:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:58:19 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-12-14 14:58:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-14 14:58:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 14:59:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 14:59:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 14:59:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 14:59:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:59:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:59:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:59:19 [WARNING ] (13, 1, 'bot')
2018-12-14 14:59:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 14:59:19 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-12-14 14:59:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 14:59:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 14:59:58 [DEBUG   ] Got command RPT from MCS: ref #836486
2018-12-14 14:59:58 [DEBUG   ] summary = ERROR
2018-12-14 14:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836486  13 58466 53998421 A  ERRORERROR'
2018-12-14 14:59:58 [DEBUG   ] Got command RPT from MCS: ref #836487
2018-12-14 14:59:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836487  77 58466 53998625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:59:58 [DEBUG   ] Got command RPT from MCS: ref #836488
2018-12-14 14:59:58 [DEBUG   ] summary = ERROR
2018-12-14 14:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836488  13 58466 53998829 A  ERRORERROR'
2018-12-14 14:59:59 [DEBUG   ] Got command RPT from MCS: ref #836490
2018-12-14 14:59:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 14:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836490  77 58466 53999021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 14:59:59 [DEBUG   ] Got command RPT from MCS: ref #836491
2018-12-14 14:59:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 14:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836491  12 58466 53999225 A  ERRORB—™š'
2018-12-14 15:00:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 15:00:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:00:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:00:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:00:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:00:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:00:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:00:19 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-12-14 15:00:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 15:00:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 15:00:54 [DEBUG   ] Got command RPT from MCS: ref #836496
2018-12-14 15:00:54 [DEBUG   ] summary = ERROR
2018-12-14 15:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836496  13 58466 54054625 A  ERRORERROR'
2018-12-14 15:00:54 [DEBUG   ] Got command RPT from MCS: ref #836497
2018-12-14 15:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836497  77 58466 54054626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:01:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 15:01:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:01:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:01:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:01:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:01:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:01:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:01:19 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-12-14 15:01:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 15:01:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:02:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 15:02:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:02:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:02:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:02:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:02:19 [WARNING ] (13, 1, 'bot')
2018-12-14 15:02:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:02:19 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-12-14 15:02:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 15:02:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 15:03:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 15:03:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:03:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:03:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:03:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:03:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:03:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:03:20 [DEBUG   ] Finished updating board flags in 2.039 seconds
2018-12-14 15:03:32 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 15:03:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 15:04:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 15:04:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 15:04:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:04:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 15:04:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:04:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:04:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:04:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:04:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:04:20 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-12-14 15:04:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 15:04:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 15:04:58 [DEBUG   ] Got command RPT from MCS: ref #836517
2018-12-14 15:04:58 [DEBUG   ] summary = ERROR
2018-12-14 15:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836517  13 58466 54298505 A  ERRORERROR'
2018-12-14 15:04:58 [DEBUG   ] Got command RPT from MCS: ref #836518
2018-12-14 15:04:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836518  77 58466 54298709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:04:58 [DEBUG   ] Got command RPT from MCS: ref #836519
2018-12-14 15:04:58 [DEBUG   ] summary = ERROR
2018-12-14 15:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836519  13 58466 54298901 A  ERRORERROR'
2018-12-14 15:04:59 [DEBUG   ] Got command RPT from MCS: ref #836520
2018-12-14 15:04:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836520  77 58466 54299105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:04:59 [DEBUG   ] Got command RPT from MCS: ref #836521
2018-12-14 15:04:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 15:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836521  12 58466 54299309 A  ERRORB—™š'
2018-12-14 15:05:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 15:05:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:05:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:05:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:05:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:05:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:05:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:05:20 [DEBUG   ] Finished updating board flags in 1.862 seconds
2018-12-14 15:05:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 15:05:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 15:05:54 [DEBUG   ] Got command RPT from MCS: ref #836526
2018-12-14 15:05:54 [DEBUG   ] summary = ERROR
2018-12-14 15:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836526  13 58466 54354629 A  ERRORERROR'
2018-12-14 15:05:54 [DEBUG   ] Got command RPT from MCS: ref #836527
2018-12-14 15:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836527  77 58466 54354630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:06:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 15:06:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:06:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 15:06:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:06:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:06:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:06:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:06:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:06:20 [DEBUG   ] Finished updating board flags in 1.751 seconds
2018-12-14 15:06:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 15:06:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 15:07:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 15:07:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:07:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:07:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:07:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:07:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:07:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:07:20 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-12-14 15:07:32 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 15:07:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 15:08:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 15:08:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:08:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:08:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:08:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:08:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:08:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:08:20 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-12-14 15:08:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 15:08:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:09:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:09:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:09:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:09:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:09:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:09:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:09:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:09:20 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-14 15:09:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:09:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 15:09:58 [DEBUG   ] Got command RPT from MCS: ref #836549
2018-12-14 15:09:58 [DEBUG   ] summary = ERROR
2018-12-14 15:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836549  13 58466 54598581 A  ERRORERROR'
2018-12-14 15:09:58 [DEBUG   ] Got command RPT from MCS: ref #836550
2018-12-14 15:09:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836550  77 58466 54598785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:09:58 [DEBUG   ] Got command RPT from MCS: ref #836551
2018-12-14 15:09:58 [DEBUG   ] summary = ERROR
2018-12-14 15:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836551  13 58466 54598989 A  ERRORERROR'
2018-12-14 15:09:59 [DEBUG   ] Got command RPT from MCS: ref #836553
2018-12-14 15:09:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836553  77 58466 54599181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:09:59 [DEBUG   ] Got command RPT from MCS: ref #836554
2018-12-14 15:09:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 15:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836554  12 58466 54599385 A  ERRORB–™š'
2018-12-14 15:10:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 15:10:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:10:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:10:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:10:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:10:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:10:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:10:20 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-12-14 15:10:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:10:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 15:10:54 [DEBUG   ] Got command RPT from MCS: ref #836559
2018-12-14 15:10:54 [DEBUG   ] summary = ERROR
2018-12-14 15:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836559  13 58466 54654629 A  ERRORERROR'
2018-12-14 15:10:54 [DEBUG   ] Got command RPT from MCS: ref #836560
2018-12-14 15:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836560  77 58466 54654630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:11:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 15:11:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:11:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 15:11:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:11:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:11:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:11:20 [WARNING ] (13, 1, 'bot')
2018-12-14 15:11:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:11:20 [DEBUG   ] Finished updating board flags in 1.539 seconds
2018-12-14 15:11:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 15:11:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:12:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:12:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:12:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:12:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:12:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:12:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:12:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:12:21 [DEBUG   ] Finished updating board flags in 2.230 seconds
2018-12-14 15:12:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 15:12:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 15:13:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:13:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:13:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:13:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:13:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:13:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:13:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:13:21 [DEBUG   ] Finished updating board flags in 2.111 seconds
2018-12-14 15:13:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:13:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:14:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:14:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:14:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:14:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:14:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:14:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:14:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:14:21 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-12-14 15:14:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:14:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:14:58 [DEBUG   ] Got command RPT from MCS: ref #836584
2018-12-14 15:14:58 [DEBUG   ] summary = ERROR
2018-12-14 15:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836584  13 58466 54898657 A  ERRORERROR'
2018-12-14 15:14:58 [DEBUG   ] Got command RPT from MCS: ref #836585
2018-12-14 15:14:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836585  77 58466 54898861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:14:59 [DEBUG   ] Got command RPT from MCS: ref #836586
2018-12-14 15:14:59 [DEBUG   ] summary = ERROR
2018-12-14 15:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836586  13 58466 54899065 A  ERRORERROR'
2018-12-14 15:14:59 [DEBUG   ] Got command RPT from MCS: ref #836587
2018-12-14 15:14:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836587  77 58466 54899257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:14:59 [DEBUG   ] Got command RPT from MCS: ref #836588
2018-12-14 15:14:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 15:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836588  12 58466 54899461 A  ERRORB•™š'
2018-12-14 15:15:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 15:15:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:15:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:15:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:15:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:15:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:15:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:15:21 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-12-14 15:15:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:15:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:15:54 [DEBUG   ] Got command RPT from MCS: ref #836589
2018-12-14 15:15:54 [DEBUG   ] summary = ERROR
2018-12-14 15:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836589  13 58466 54954625 A  ERRORERROR'
2018-12-14 15:15:54 [DEBUG   ] Got command RPT from MCS: ref #836590
2018-12-14 15:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836590  77 58466 54954626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:16:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:16:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:16:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:16:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:16:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:16:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:16:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:16:21 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-14 15:16:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 15:16:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:17:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:17:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:17:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:17:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:17:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:17:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:17:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:17:21 [DEBUG   ] Finished updating board flags in 1.865 seconds
2018-12-14 15:17:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:17:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:18:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:18:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:18:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:18:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:18:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:18:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:18:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:18:21 [DEBUG   ] Finished updating board flags in 1.710 seconds
2018-12-14 15:18:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:18:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:19:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:19:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:19:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 15:19:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:19:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:19:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:19:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:19:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:19:21 [DEBUG   ] Finished updating board flags in 1.660 seconds
2018-12-14 15:19:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:19:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:19:58 [DEBUG   ] Got command RPT from MCS: ref #836612
2018-12-14 15:19:58 [DEBUG   ] summary = ERROR
2018-12-14 15:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836612  13 58466 55198734 A  ERRORERROR'
2018-12-14 15:19:58 [DEBUG   ] Got command RPT from MCS: ref #836613
2018-12-14 15:19:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836613  77 58466 55198937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:19:59 [DEBUG   ] Got command RPT from MCS: ref #836614
2018-12-14 15:19:59 [DEBUG   ] summary = ERROR
2018-12-14 15:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836614  13 58466 55199141 A  ERRORERROR'
2018-12-14 15:19:59 [DEBUG   ] Got command RPT from MCS: ref #836615
2018-12-14 15:19:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836615  77 58466 55199345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:19:59 [DEBUG   ] Got command RPT from MCS: ref #836617
2018-12-14 15:19:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 15:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836617  12 58466 55199538 A  ERRORB—™š'
2018-12-14 15:20:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:20:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:20:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:20:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:20:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:20:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:20:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:20:21 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-12-14 15:20:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 15:20:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 15:20:54 [DEBUG   ] Got command RPT from MCS: ref #836626
2018-12-14 15:20:54 [DEBUG   ] summary = ERROR
2018-12-14 15:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836626  13 58466 55254633 A  ERRORERROR'
2018-12-14 15:20:54 [DEBUG   ] Got command RPT from MCS: ref #836627
2018-12-14 15:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836627  77 58466 55254634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:21:13 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 15:21:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:21:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:21:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:21:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:21:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:21:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:21:21 [DEBUG   ] Finished updating board flags in 1.526 seconds
2018-12-14 15:21:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 15:21:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 15:22:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 15:22:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:22:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:22:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:22:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:22:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:22:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:22:21 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-12-14 15:22:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 15:22:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 15:23:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 15:23:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:23:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:23:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:23:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:23:21 [WARNING ] (13, 1, 'bot')
2018-12-14 15:23:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:23:21 [DEBUG   ] Finished updating board flags in 1.518 seconds
2018-12-14 15:23:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:23:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:24:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 15:24:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:24:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:24:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:24:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:24:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:24:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:24:22 [DEBUG   ] Finished updating board flags in 2.227 seconds
2018-12-14 15:24:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 15:24:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:24:58 [DEBUG   ] Got command RPT from MCS: ref #836647
2018-12-14 15:24:58 [DEBUG   ] summary = ERROR
2018-12-14 15:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836647  13 58466 55498813 A  ERRORERROR'
2018-12-14 15:24:59 [DEBUG   ] Got command RPT from MCS: ref #836648
2018-12-14 15:24:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836648  77 58466 55499017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:24:59 [DEBUG   ] Got command RPT from MCS: ref #836649
2018-12-14 15:24:59 [DEBUG   ] summary = ERROR
2018-12-14 15:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836649  13 58466 55499221 A  ERRORERROR'
2018-12-14 15:24:59 [DEBUG   ] Got command RPT from MCS: ref #836650
2018-12-14 15:24:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836650  77 58466 55499413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:24:59 [DEBUG   ] Got command RPT from MCS: ref #836651
2018-12-14 15:24:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 15:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836651  12 58466 55499617 A  ERRORB—™š'
2018-12-14 15:25:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:25:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:25:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:25:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:25:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:25:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:25:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:25:22 [DEBUG   ] Finished updating board flags in 2.161 seconds
2018-12-14 15:25:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 15:25:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 15:25:54 [DEBUG   ] Got command RPT from MCS: ref #836652
2018-12-14 15:25:54 [DEBUG   ] summary = ERROR
2018-12-14 15:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836652  13 58466 55554633 A  ERRORERROR'
2018-12-14 15:25:54 [DEBUG   ] Got command RPT from MCS: ref #836653
2018-12-14 15:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836653  77 58466 55554634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:26:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 15:26:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:26:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:26:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:26:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:26:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:26:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:26:22 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-12-14 15:26:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 15:26:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 15:27:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 15:27:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:27:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:27:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:27:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:27:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:27:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:27:22 [DEBUG   ] Finished updating board flags in 1.770 seconds
2018-12-14 15:27:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 15:27:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 15:28:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 15:28:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:28:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:28:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:28:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:28:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:28:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:28:22 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-14 15:28:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 15:28:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 15:29:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 15:29:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:29:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:29:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:29:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:29:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:29:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:29:22 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-14 15:29:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 15:29:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:29:58 [DEBUG   ] Got command RPT from MCS: ref #836679
2018-12-14 15:29:58 [DEBUG   ] summary = ERROR
2018-12-14 15:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836679  13 58466 55798889 A  ERRORERROR'
2018-12-14 15:29:59 [DEBUG   ] Got command RPT from MCS: ref #836680
2018-12-14 15:29:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836680  77 58466 55799093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:29:59 [DEBUG   ] Got command RPT from MCS: ref #836681
2018-12-14 15:29:59 [DEBUG   ] summary = ERROR
2018-12-14 15:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836681  13 58466 55799297 A  ERRORERROR'
2018-12-14 15:29:59 [DEBUG   ] Got command RPT from MCS: ref #836682
2018-12-14 15:29:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836682  77 58466 55799501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:29:59 [DEBUG   ] Got command RPT from MCS: ref #836684
2018-12-14 15:29:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 15:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836684  12 58466 55799693 A  ERRORB•™š'
2018-12-14 15:30:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 15:30:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:30:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 15:30:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 15:30:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:30:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:30:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:30:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:30:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:30:22 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-12-14 15:30:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 15:30:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 15:30:54 [DEBUG   ] Got command RPT from MCS: ref #836689
2018-12-14 15:30:54 [DEBUG   ] summary = ERROR
2018-12-14 15:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836689  13 58466 55854629 A  ERRORERROR'
2018-12-14 15:30:54 [DEBUG   ] Got command RPT from MCS: ref #836690
2018-12-14 15:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836690  77 58466 55854630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:31:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:31:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:31:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:31:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:31:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:31:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:31:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:31:22 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-12-14 15:31:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:31:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 15:32:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 15:32:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:32:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:32:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:32:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:32:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:32:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:32:22 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-12-14 15:32:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 15:32:55 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 15:33:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 15:33:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:33:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:33:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:33:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:33:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:33:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:33:22 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-12-14 15:33:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 15:33:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 15:34:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 15:34:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:34:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:34:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:34:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:34:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:34:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:34:22 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-12-14 15:34:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 15:34:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:34:58 [DEBUG   ] Got command RPT from MCS: ref #836710
2018-12-14 15:34:58 [DEBUG   ] summary = ERROR
2018-12-14 15:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836710  13 58466 56098973 A  ERRORERROR'
2018-12-14 15:34:59 [DEBUG   ] Got command RPT from MCS: ref #836711
2018-12-14 15:34:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836711  77 58466 56099177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:34:59 [DEBUG   ] Got command RPT from MCS: ref #836712
2018-12-14 15:34:59 [DEBUG   ] summary = ERROR
2018-12-14 15:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836712  13 58466 56099381 A  ERRORERROR'
2018-12-14 15:34:59 [DEBUG   ] Got command RPT from MCS: ref #836713
2018-12-14 15:34:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836713  77 58466 56099573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:34:59 [DEBUG   ] Got command RPT from MCS: ref #836714
2018-12-14 15:34:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 15:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836714  12 58466 56099777 A  ERRORB—™š'
2018-12-14 15:35:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 15:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 15:35:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:35:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 15:35:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:35:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:35:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:35:22 [WARNING ] (13, 1, 'bot')
2018-12-14 15:35:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:35:22 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-12-14 15:35:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 15:35:54 [DEBUG   ] Got command RPT from MCS: ref #836719
2018-12-14 15:35:54 [DEBUG   ] summary = ERROR
2018-12-14 15:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836719  13 58466 56154629 A  ERRORERROR'
2018-12-14 15:35:54 [DEBUG   ] Got command RPT from MCS: ref #836720
2018-12-14 15:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836720  77 58466 56154630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:35:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 15:36:16 [DEBUG   ] Finished updating ant stats in 1.288 seconds
2018-12-14 15:36:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:36:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:36:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:36:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:36:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:36:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:36:23 [DEBUG   ] Finished updating board flags in 2.046 seconds
2018-12-14 15:36:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 15:36:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 15:37:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 15:37:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:37:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:37:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:37:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:37:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:37:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:37:23 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-12-14 15:37:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 15:37:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 15:38:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 15:38:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:38:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:38:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:38:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:38:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:38:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:38:23 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-12-14 15:38:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:38:56 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-14 15:39:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 15:39:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:39:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:39:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:39:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:39:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:39:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:39:23 [DEBUG   ] Finished updating board flags in 1.971 seconds
2018-12-14 15:39:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:39:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:39:59 [DEBUG   ] Got command RPT from MCS: ref #836742
2018-12-14 15:39:59 [DEBUG   ] summary = ERROR
2018-12-14 15:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836742  13 58466 56399049 A  ERRORERROR'
2018-12-14 15:39:59 [DEBUG   ] Got command RPT from MCS: ref #836743
2018-12-14 15:39:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836743  77 58466 56399253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:39:59 [DEBUG   ] Got command RPT from MCS: ref #836744
2018-12-14 15:39:59 [DEBUG   ] summary = ERROR
2018-12-14 15:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836744  13 58466 56399457 A  ERRORERROR'
2018-12-14 15:39:59 [DEBUG   ] Got command RPT from MCS: ref #836745
2018-12-14 15:39:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836745  77 58466 56399649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:39:59 [DEBUG   ] Got command RPT from MCS: ref #836747
2018-12-14 15:39:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 15:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836747  12 58466 56399853 A  ERRORB–™š'
2018-12-14 15:40:16 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 15:40:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:40:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 15:40:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:40:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:40:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:40:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:40:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:40:23 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-12-14 15:40:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 15:40:54 [DEBUG   ] Got command RPT from MCS: ref #836752
2018-12-14 15:40:54 [DEBUG   ] summary = ERROR
2018-12-14 15:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836752  13 58466 56454637 A  ERRORERROR'
2018-12-14 15:40:54 [DEBUG   ] Got command RPT from MCS: ref #836753
2018-12-14 15:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836753  77 58466 56454638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:40:57 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-14 15:41:17 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 15:41:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:41:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:41:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:41:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:41:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:41:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:41:23 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-14 15:41:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 15:41:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 15:42:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 15:42:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 15:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 15:42:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:42:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:42:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:42:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:42:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:42:23 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-12-14 15:42:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 15:42:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 15:43:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:43:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:43:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:43:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:43:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:43:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:43:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:43:23 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-14 15:43:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:43:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 15:44:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 15:44:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:44:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:44:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:44:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:44:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:44:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:44:23 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-12-14 15:44:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:44:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:44:59 [DEBUG   ] Got command RPT from MCS: ref #836777
2018-12-14 15:44:59 [DEBUG   ] summary = ERROR
2018-12-14 15:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836777  13 58466 56699129 A  ERRORERROR'
2018-12-14 15:44:59 [DEBUG   ] Got command RPT from MCS: ref #836778
2018-12-14 15:44:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836778  77 58466 56699333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:44:59 [DEBUG   ] Got command RPT from MCS: ref #836779
2018-12-14 15:44:59 [DEBUG   ] summary = ERROR
2018-12-14 15:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836779  13 58466 56699537 A  ERRORERROR'
2018-12-14 15:44:59 [DEBUG   ] Got command RPT from MCS: ref #836780
2018-12-14 15:44:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836780  77 58466 56699729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:44:59 [DEBUG   ] Got command RPT from MCS: ref #836781
2018-12-14 15:44:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 15:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836781  12 58466 56699933 A  ERRORB•™š'
2018-12-14 15:45:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 15:45:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:45:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:45:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:45:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:45:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:45:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:45:23 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-12-14 15:45:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 15:45:54 [DEBUG   ] Got command RPT from MCS: ref #836782
2018-12-14 15:45:54 [DEBUG   ] summary = ERROR
2018-12-14 15:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836782  13 58466 56754633 A  ERRORERROR'
2018-12-14 15:45:54 [DEBUG   ] Got command RPT from MCS: ref #836783
2018-12-14 15:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836783  77 58466 56754634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:45:58 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 15:46:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 15:46:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:46:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:46:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:46:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:46:23 [WARNING ] (13, 1, 'bot')
2018-12-14 15:46:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:46:23 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-12-14 15:46:38 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-14 15:46:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 15:47:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 15:47:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:47:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 15:47:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:47:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:47:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:47:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:47:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:47:24 [DEBUG   ] Finished updating board flags in 2.213 seconds
2018-12-14 15:47:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 15:47:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 15:48:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:48:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:48:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:48:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:48:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:48:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:48:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:48:24 [DEBUG   ] Finished updating board flags in 2.181 seconds
2018-12-14 15:48:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 15:48:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 15:49:18 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-14 15:49:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:49:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:49:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:49:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:49:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:49:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:49:24 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-12-14 15:49:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:49:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:49:59 [DEBUG   ] Got command RPT from MCS: ref #836805
2018-12-14 15:49:59 [DEBUG   ] summary = ERROR
2018-12-14 15:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836805  13 58466 56999205 A  ERRORERROR'
2018-12-14 15:49:59 [DEBUG   ] Got command RPT from MCS: ref #836806
2018-12-14 15:49:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836806  77 58466 56999409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:49:59 [DEBUG   ] Got command RPT from MCS: ref #836807
2018-12-14 15:49:59 [DEBUG   ] summary = ERROR
2018-12-14 15:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836807  13 58466 56999613 A  ERRORERROR'
2018-12-14 15:49:59 [DEBUG   ] Got command RPT from MCS: ref #836808
2018-12-14 15:49:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836808  77 58466 56999817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:50:00 [DEBUG   ] Got command RPT from MCS: ref #836810
2018-12-14 15:50:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 15:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836810  12 58466 57000009 A  ERRORB–™š'
2018-12-14 15:50:18 [DEBUG   ] Finished updating ant stats in 0.588 seconds
2018-12-14 15:50:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:50:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:50:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:50:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:50:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:50:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:50:24 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-12-14 15:50:39 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-14 15:50:54 [DEBUG   ] Got command RPT from MCS: ref #836819
2018-12-14 15:50:54 [DEBUG   ] summary = ERROR
2018-12-14 15:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836819  13 58466 57054641 A  ERRORERROR'
2018-12-14 15:50:54 [DEBUG   ] Got command RPT from MCS: ref #836820
2018-12-14 15:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836820  77 58466 57054642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:50:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 15:51:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 15:51:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:51:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 15:51:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:51:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:51:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:51:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:51:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:51:24 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-12-14 15:51:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 15:51:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 15:52:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 15:52:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:52:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:52:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:52:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:52:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:52:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:52:24 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-14 15:52:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 15:52:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 15:53:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 15:53:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:53:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 15:53:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:53:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:53:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:53:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:53:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:53:24 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-12-14 15:53:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 15:53:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 15:54:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:54:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:54:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:54:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:54:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:54:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:54:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:54:24 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-14 15:54:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 15:54:59 [DEBUG   ] Got command RPT from MCS: ref #836840
2018-12-14 15:54:59 [DEBUG   ] summary = ERROR
2018-12-14 15:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836840  13 58466 57299289 A  ERRORERROR'
2018-12-14 15:54:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 15:54:59 [DEBUG   ] Got command RPT from MCS: ref #836841
2018-12-14 15:54:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836841  77 58466 57299481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:54:59 [DEBUG   ] Got command RPT from MCS: ref #836842
2018-12-14 15:54:59 [DEBUG   ] summary = ERROR
2018-12-14 15:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836842  13 58466 57299685 A  ERRORERROR'
2018-12-14 15:54:59 [DEBUG   ] Got command RPT from MCS: ref #836843
2018-12-14 15:54:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836843  77 58466 57299889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:55:00 [DEBUG   ] Got command RPT from MCS: ref #836844
2018-12-14 15:55:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 15:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836844  12 58466 57300093 A  ERRORB–™š'
2018-12-14 15:55:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 15:55:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:55:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:55:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:55:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:55:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:55:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:55:24 [DEBUG   ] Finished updating board flags in 1.671 seconds
2018-12-14 15:55:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 15:55:54 [DEBUG   ] Got command RPT from MCS: ref #836845
2018-12-14 15:55:54 [DEBUG   ] summary = ERROR
2018-12-14 15:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836845  13 58466 57354641 A  ERRORERROR'
2018-12-14 15:55:54 [DEBUG   ] Got command RPT from MCS: ref #836846
2018-12-14 15:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836846  77 58466 57354642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:55:59 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2018-12-14 15:56:19 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-12-14 15:56:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:56:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:56:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:56:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:56:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:56:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:56:24 [DEBUG   ] Finished updating board flags in 1.518 seconds
2018-12-14 15:56:40 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-14 15:57:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 15:57:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 15:57:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:57:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:57:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:57:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:57:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:57:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:57:24 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-14 15:57:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 15:58:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 15:58:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 15:58:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:58:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:58:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:58:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:58:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:58:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:58:24 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-12-14 15:58:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 15:59:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 15:59:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 15:59:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 15:59:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:59:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:59:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:59:24 [WARNING ] (13, 1, 'bot')
2018-12-14 15:59:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 15:59:24 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-14 15:59:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 15:59:59 [DEBUG   ] Got command RPT from MCS: ref #836872
2018-12-14 15:59:59 [DEBUG   ] summary = ERROR
2018-12-14 15:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836872  13 58466 57599361 A  ERRORERROR'
2018-12-14 15:59:59 [DEBUG   ] Got command RPT from MCS: ref #836873
2018-12-14 15:59:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836873  77 58466 57599570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 15:59:59 [DEBUG   ] Got command RPT from MCS: ref #836874
2018-12-14 15:59:59 [DEBUG   ] summary = ERROR
2018-12-14 15:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836874  13 58466 57599769 A  ERRORERROR'
2018-12-14 15:59:59 [DEBUG   ] Got command RPT from MCS: ref #836876
2018-12-14 15:59:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 15:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836876  77 58466 57599973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:00:00 [DEBUG   ] Got command RPT from MCS: ref #836877
2018-12-14 16:00:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836877  12 58466 57600165 A  ERRORB–™š'
2018-12-14 16:00:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 16:00:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 16:00:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:00:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:00:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:00:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:00:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:00:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:00:24 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-12-14 16:00:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:00:54 [DEBUG   ] Got command RPT from MCS: ref #836882
2018-12-14 16:00:54 [DEBUG   ] summary = ERROR
2018-12-14 16:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836882  13 58466 57654637 A  ERRORERROR'
2018-12-14 16:00:54 [DEBUG   ] Got command RPT from MCS: ref #836883
2018-12-14 16:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836883  77 58466 57654638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:01:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:01:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 16:01:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:01:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:01:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:01:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:01:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:01:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:01:24 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-12-14 16:01:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 16:02:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 16:02:20 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 16:02:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 16:02:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:02:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:02:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:02:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:02:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:02:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:02:24 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-12-14 16:02:41 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-14 16:03:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 16:03:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 16:03:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:03:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:03:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:03:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:03:24 [WARNING ] (13, 1, 'bot')
2018-12-14 16:03:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:03:24 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-12-14 16:03:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 16:04:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 16:04:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 16:04:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:04:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:04:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:04:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:04:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:04:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:04:25 [DEBUG   ] Finished updating board flags in 2.210 seconds
2018-12-14 16:04:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 16:04:59 [DEBUG   ] Got command RPT from MCS: ref #836903
2018-12-14 16:04:59 [DEBUG   ] summary = ERROR
2018-12-14 16:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836903  13 58466 57899441 A  ERRORERROR'
2018-12-14 16:04:59 [DEBUG   ] Got command RPT from MCS: ref #836904
2018-12-14 16:04:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836904  77 58466 57899645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:04:59 [DEBUG   ] Got command RPT from MCS: ref #836905
2018-12-14 16:04:59 [DEBUG   ] summary = ERROR
2018-12-14 16:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836905  13 58466 57899849 A  ERRORERROR'
2018-12-14 16:05:00 [DEBUG   ] Got command RPT from MCS: ref #836906
2018-12-14 16:05:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836906  77 58466 57900041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:05:00 [DEBUG   ] Got command RPT from MCS: ref #836907
2018-12-14 16:05:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836907  12 58466 57900245 A  ERRORB—™š'
2018-12-14 16:05:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 16:05:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 16:05:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:05:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:05:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:05:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:05:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:05:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:05:25 [DEBUG   ] Finished updating board flags in 2.178 seconds
2018-12-14 16:05:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 16:05:54 [DEBUG   ] Got command RPT from MCS: ref #836912
2018-12-14 16:05:54 [DEBUG   ] summary = ERROR
2018-12-14 16:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836912  13 58466 57954641 A  ERRORERROR'
2018-12-14 16:05:54 [DEBUG   ] Got command RPT from MCS: ref #836913
2018-12-14 16:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836913  77 58466 57954642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:06:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-14 16:06:22 [DEBUG   ] Finished updating ant stats in 1.796 seconds
2018-12-14 16:06:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:06:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:06:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:06:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:06:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:06:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:06:25 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-12-14 16:06:41 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2018-12-14 16:07:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:07:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:07:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:07:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:07:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:07:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:07:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:07:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:07:25 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-12-14 16:07:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 16:08:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 16:08:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:08:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:08:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 16:08:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:08:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:08:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:08:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:08:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:08:25 [DEBUG   ] Finished updating board flags in 1.961 seconds
2018-12-14 16:08:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 16:09:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 16:09:22 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 16:09:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:09:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 16:09:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:09:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:09:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:09:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:09:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:09:25 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-14 16:09:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 16:09:59 [DEBUG   ] Got command RPT from MCS: ref #836935
2018-12-14 16:09:59 [DEBUG   ] summary = ERROR
2018-12-14 16:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836935  13 58466 58199521 A  ERRORERROR'
2018-12-14 16:09:59 [DEBUG   ] Got command RPT from MCS: ref #836936
2018-12-14 16:09:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836936  77 58466 58199725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:09:59 [DEBUG   ] Got command RPT from MCS: ref #836937
2018-12-14 16:09:59 [DEBUG   ] summary = ERROR
2018-12-14 16:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836937  13 58466 58199929 A  ERRORERROR'
2018-12-14 16:10:00 [DEBUG   ] Got command RPT from MCS: ref #836938
2018-12-14 16:10:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836938  77 58466 58200121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:10:00 [DEBUG   ] Got command RPT from MCS: ref #836940
2018-12-14 16:10:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836940  12 58466 58200325 A  ERRORB•™š'
2018-12-14 16:10:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 16:10:22 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-12-14 16:10:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:10:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:10:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:10:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:10:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:10:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:10:25 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-12-14 16:10:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 16:10:54 [DEBUG   ] Got command RPT from MCS: ref #836945
2018-12-14 16:10:54 [DEBUG   ] summary = ERROR
2018-12-14 16:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836945  13 58466 58254645 A  ERRORERROR'
2018-12-14 16:10:54 [DEBUG   ] Got command RPT from MCS: ref #836946
2018-12-14 16:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836946  77 58466 58254646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:11:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 16:11:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 16:11:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:11:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:11:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:11:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:11:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:11:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:11:25 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-14 16:11:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 16:12:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 16:12:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 16:12:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:12:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:12:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:12:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:12:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:12:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:12:25 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-12-14 16:12:42 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-12-14 16:13:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 16:13:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:13:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:13:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:13:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:13:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:13:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:13:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:13:25 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-14 16:13:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 16:14:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 16:14:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 16:14:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:14:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:14:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:14:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:14:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:14:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:14:25 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-12-14 16:14:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 16:14:59 [DEBUG   ] Got command RPT from MCS: ref #836970
2018-12-14 16:14:59 [DEBUG   ] summary = ERROR
2018-12-14 16:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836970  13 58466 58499601 A  ERRORERROR'
2018-12-14 16:14:59 [DEBUG   ] Got command RPT from MCS: ref #836971
2018-12-14 16:14:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836971  77 58466 58499805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:15:00 [DEBUG   ] Got command RPT from MCS: ref #836972
2018-12-14 16:15:00 [DEBUG   ] summary = ERROR
2018-12-14 16:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836972  13 58466 58500009 A  ERRORERROR'
2018-12-14 16:15:00 [DEBUG   ] Got command RPT from MCS: ref #836973
2018-12-14 16:15:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836973  77 58466 58500201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:15:00 [DEBUG   ] Got command RPT from MCS: ref #836974
2018-12-14 16:15:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836974  12 58466 58500405 A  ERRORB–™š'
2018-12-14 16:15:02 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 16:15:22 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 16:15:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:15:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 16:15:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:15:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:15:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:15:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:15:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:15:25 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-12-14 16:15:43 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2018-12-14 16:15:54 [DEBUG   ] Got command RPT from MCS: ref #836975
2018-12-14 16:15:54 [DEBUG   ] summary = ERROR
2018-12-14 16:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836975  13 58466 58554637 A  ERRORERROR'
2018-12-14 16:15:54 [DEBUG   ] Got command RPT from MCS: ref #836976
2018-12-14 16:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836976  77 58466 58554638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:16:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 16:16:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 16:16:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-14 16:16:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:16:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:16:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:16:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:16:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:16:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:16:25 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-12-14 16:16:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 16:17:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 16:17:23 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 16:17:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:17:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:17:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:17:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:17:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:17:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:17:25 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-12-14 16:17:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 16:18:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 16:18:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 16:18:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:18:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:18:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:18:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:18:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:18:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:18:25 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-12-14 16:18:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 16:19:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 16:19:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:19:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:19:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 16:19:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:19:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:19:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:19:25 [WARNING ] (13, 1, 'bot')
2018-12-14 16:19:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:19:25 [DEBUG   ] Finished updating board flags in 1.324 seconds
2018-12-14 16:19:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:19:59 [DEBUG   ] Got command RPT from MCS: ref #836998
2018-12-14 16:19:59 [DEBUG   ] summary = ERROR
2018-12-14 16:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836998  13 58466 58799681 A  ERRORERROR'
2018-12-14 16:19:59 [DEBUG   ] Got command RPT from MCS: ref #836999
2018-12-14 16:19:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   836999  77 58466 58799885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:20:00 [DEBUG   ] Got command RPT from MCS: ref #837000
2018-12-14 16:20:00 [DEBUG   ] summary = ERROR
2018-12-14 16:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837000  13 58466 58800089 A  ERRORERROR'
2018-12-14 16:20:00 [DEBUG   ] Got command RPT from MCS: ref #837002
2018-12-14 16:20:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837002  77 58466 58800281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:20:00 [DEBUG   ] Got command RPT from MCS: ref #837003
2018-12-14 16:20:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837003  12 58466 58800485 A  ERRORB–™š'
2018-12-14 16:20:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 16:20:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 16:20:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:20:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 16:20:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:20:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:20:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:20:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:20:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:20:26 [DEBUG   ] Finished updating board flags in 2.103 seconds
2018-12-14 16:20:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-14 16:20:54 [DEBUG   ] Got command RPT from MCS: ref #837012
2018-12-14 16:20:54 [DEBUG   ] summary = ERROR
2018-12-14 16:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837012  13 58466 58854645 A  ERRORERROR'
2018-12-14 16:20:54 [DEBUG   ] Got command RPT from MCS: ref #837013
2018-12-14 16:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837013  77 58466 58854646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:21:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 16:21:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 16:21:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:21:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:21:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:21:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:21:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:21:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:21:26 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-12-14 16:21:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 16:22:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 16:22:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 16:22:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:22:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:22:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:22:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:22:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:22:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:22:26 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-12-14 16:22:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 16:23:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 16:23:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 16:23:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:23:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:23:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:23:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:23:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:23:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:23:26 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-12-14 16:23:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 16:24:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 16:24:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 16:24:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:24:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:24:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:24:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:24:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:24:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:24:26 [DEBUG   ] Finished updating board flags in 1.645 seconds
2018-12-14 16:24:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 16:24:59 [DEBUG   ] Got command RPT from MCS: ref #837033
2018-12-14 16:24:59 [DEBUG   ] summary = ERROR
2018-12-14 16:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837033  13 58466 59099761 A  ERRORERROR'
2018-12-14 16:24:59 [DEBUG   ] Got command RPT from MCS: ref #837034
2018-12-14 16:24:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837034  77 58466 59099965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:25:00 [DEBUG   ] Got command RPT from MCS: ref #837035
2018-12-14 16:25:00 [DEBUG   ] summary = ERROR
2018-12-14 16:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837035  13 58466 59100169 A  ERRORERROR'
2018-12-14 16:25:00 [DEBUG   ] Got command RPT from MCS: ref #837036
2018-12-14 16:25:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837036  77 58466 59100361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:25:00 [DEBUG   ] Got command RPT from MCS: ref #837037
2018-12-14 16:25:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837037  12 58466 59100565 A  ERRORB•™š'
2018-12-14 16:25:04 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2018-12-14 16:25:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 16:25:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:25:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:25:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:25:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:25:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:25:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:25:26 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-12-14 16:25:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 16:25:54 [DEBUG   ] Got command RPT from MCS: ref #837038
2018-12-14 16:25:54 [DEBUG   ] summary = ERROR
2018-12-14 16:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837038  13 58466 59154641 A  ERRORERROR'
2018-12-14 16:25:54 [DEBUG   ] Got command RPT from MCS: ref #837039
2018-12-14 16:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837039  77 58466 59154642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:26:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 16:26:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 16:26:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:26:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:26:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:26:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:26:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:26:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:26:26 [DEBUG   ] Finished updating board flags in 1.459 seconds
2018-12-14 16:26:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 16:27:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 16:27:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 16:27:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:27:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:27:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:27:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:27:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:27:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:27:26 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-12-14 16:27:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 16:28:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 16:28:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 16:28:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:28:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:28:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:28:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:28:26 [WARNING ] (13, 1, 'bot')
2018-12-14 16:28:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:28:26 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-12-14 16:28:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 16:29:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 16:29:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 16:29:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:29:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:29:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:29:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:29:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:29:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:29:27 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-12-14 16:29:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:29:59 [DEBUG   ] Got command RPT from MCS: ref #837065
2018-12-14 16:29:59 [DEBUG   ] summary = ERROR
2018-12-14 16:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837065  13 58466 59399841 A  ERRORERROR'
2018-12-14 16:30:00 [DEBUG   ] Got command RPT from MCS: ref #837066
2018-12-14 16:30:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837066  77 58466 59400045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:30:00 [DEBUG   ] Got command RPT from MCS: ref #837067
2018-12-14 16:30:00 [DEBUG   ] summary = ERROR
2018-12-14 16:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837067  13 58466 59400249 A  ERRORERROR'
2018-12-14 16:30:00 [DEBUG   ] Got command RPT from MCS: ref #837069
2018-12-14 16:30:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837069  77 58466 59400441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:30:00 [DEBUG   ] Got command RPT from MCS: ref #837070
2018-12-14 16:30:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837070  12 58466 59400645 A  ERRORB•™š'
2018-12-14 16:30:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:30:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 16:30:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:30:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 16:30:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:30:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:30:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:30:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:30:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:30:27 [DEBUG   ] Finished updating board flags in 2.148 seconds
2018-12-14 16:30:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 16:30:54 [DEBUG   ] Got command RPT from MCS: ref #837075
2018-12-14 16:30:54 [DEBUG   ] summary = ERROR
2018-12-14 16:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837075  13 58466 59454645 A  ERRORERROR'
2018-12-14 16:30:54 [DEBUG   ] Got command RPT from MCS: ref #837076
2018-12-14 16:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837076  77 58466 59454646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:31:05 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-14 16:31:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 16:31:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:31:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:31:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:31:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:31:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:31:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:31:27 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-12-14 16:31:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 16:32:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 16:32:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 16:32:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:32:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:32:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:32:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:32:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:32:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:32:27 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-12-14 16:32:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 16:33:05 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2018-12-14 16:33:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 16:33:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 16:33:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:33:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:33:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:33:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:33:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:33:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:33:27 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-14 16:33:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 16:34:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 16:34:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 16:34:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:34:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:34:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:34:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:34:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:34:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:34:27 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-12-14 16:34:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:34:59 [DEBUG   ] Got command RPT from MCS: ref #837096
2018-12-14 16:34:59 [DEBUG   ] summary = ERROR
2018-12-14 16:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837096  13 58466 59699922 A  ERRORERROR'
2018-12-14 16:35:00 [DEBUG   ] Got command RPT from MCS: ref #837097
2018-12-14 16:35:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837097  77 58466 59700125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:35:00 [DEBUG   ] Got command RPT from MCS: ref #837098
2018-12-14 16:35:00 [DEBUG   ] summary = ERROR
2018-12-14 16:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837098  13 58466 59700329 A  ERRORERROR'
2018-12-14 16:35:00 [DEBUG   ] Got command RPT from MCS: ref #837099
2018-12-14 16:35:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837099  77 58466 59700522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:35:00 [DEBUG   ] Got command RPT from MCS: ref #837100
2018-12-14 16:35:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837100  12 58466 59700725 A  ERRORB–™š'
2018-12-14 16:35:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:35:25 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 16:35:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:35:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 16:35:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:35:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:35:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:35:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:35:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:35:27 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-14 16:35:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 16:35:54 [DEBUG   ] Got command RPT from MCS: ref #837105
2018-12-14 16:35:54 [DEBUG   ] summary = ERROR
2018-12-14 16:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837105  13 58466 59754642 A  ERRORERROR'
2018-12-14 16:35:54 [DEBUG   ] Got command RPT from MCS: ref #837106
2018-12-14 16:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837106  77 58466 59754642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:36:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 16:36:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 16:36:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:36:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 16:36:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:36:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:36:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:36:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:36:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:36:27 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-12-14 16:36:46 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2018-12-14 16:37:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 16:37:26 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2018-12-14 16:37:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:37:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:37:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:37:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:37:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:37:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:37:27 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-12-14 16:37:46 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-12-14 16:38:06 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-14 16:38:26 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-12-14 16:38:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:38:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:38:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:38:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:38:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:38:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:38:27 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-12-14 16:38:46 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2018-12-14 16:39:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 16:39:26 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2018-12-14 16:39:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:39:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:39:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:39:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:39:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:39:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:39:27 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-12-14 16:39:46 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-12-14 16:40:00 [DEBUG   ] Got command RPT from MCS: ref #837128
2018-12-14 16:40:00 [DEBUG   ] summary = ERROR
2018-12-14 16:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837128  13 58466 60000001 A  ERRORERROR'
2018-12-14 16:40:00 [DEBUG   ] Got command RPT from MCS: ref #837129
2018-12-14 16:40:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837129  77 58466 60000205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:40:00 [DEBUG   ] Got command RPT from MCS: ref #837130
2018-12-14 16:40:00 [DEBUG   ] summary = ERROR
2018-12-14 16:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837130  13 58466 60000409 A  ERRORERROR'
2018-12-14 16:40:00 [DEBUG   ] Got command RPT from MCS: ref #837132
2018-12-14 16:40:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837132  77 58466 60000601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:40:00 [DEBUG   ] Got command RPT from MCS: ref #837134
2018-12-14 16:40:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837134  12 58466 60000805 A  ERRORB•™š'
2018-12-14 16:40:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 16:40:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 16:40:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:40:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:40:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:40:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:40:27 [WARNING ] (13, 1, 'bot')
2018-12-14 16:40:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:40:27 [DEBUG   ] Finished updating board flags in 1.351 seconds
2018-12-14 16:40:47 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-14 16:40:54 [DEBUG   ] Got command RPT from MCS: ref #837138
2018-12-14 16:40:54 [DEBUG   ] summary = ERROR
2018-12-14 16:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837138  13 58466 60054649 A  ERRORERROR'
2018-12-14 16:40:54 [DEBUG   ] Got command RPT from MCS: ref #837139
2018-12-14 16:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837139  77 58466 60054650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:41:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 16:41:27 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2018-12-14 16:41:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:41:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:41:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:41:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:41:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:41:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:41:28 [DEBUG   ] Finished updating board flags in 2.063 seconds
2018-12-14 16:41:47 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2018-12-14 16:42:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 16:42:27 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2018-12-14 16:42:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:42:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:42:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:42:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:42:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:42:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:42:28 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-12-14 16:42:47 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-12-14 16:43:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 16:43:27 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-12-14 16:43:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:43:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:43:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:43:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:43:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:43:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:43:28 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-14 16:43:47 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2018-12-14 16:44:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 16:44:27 [DEBUG   ] Finished updating ant stats in 0.450 seconds
2018-12-14 16:44:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:44:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:44:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:44:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:44:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:44:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:44:28 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-12-14 16:44:48 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2018-12-14 16:45:00 [DEBUG   ] Got command RPT from MCS: ref #837163
2018-12-14 16:45:00 [DEBUG   ] summary = ERROR
2018-12-14 16:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837163  13 58466 60300085 A  ERRORERROR'
2018-12-14 16:45:00 [DEBUG   ] Got command RPT from MCS: ref #837164
2018-12-14 16:45:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837164  77 58466 60300277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:45:00 [DEBUG   ] Got command RPT from MCS: ref #837165
2018-12-14 16:45:00 [DEBUG   ] summary = ERROR
2018-12-14 16:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837165  13 58466 60300481 A  ERRORERROR'
2018-12-14 16:45:00 [DEBUG   ] Got command RPT from MCS: ref #837166
2018-12-14 16:45:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837166  77 58466 60300685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:45:00 [DEBUG   ] Got command RPT from MCS: ref #837167
2018-12-14 16:45:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837167  12 58466 60300889 A  ERRORB•™š'
2018-12-14 16:45:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 16:45:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 16:45:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:45:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:45:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:45:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:45:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:45:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:45:29 [DEBUG   ] Finished updating board flags in 2.624 seconds
2018-12-14 16:45:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 16:45:54 [DEBUG   ] Got command RPT from MCS: ref #837168
2018-12-14 16:45:54 [DEBUG   ] summary = ERROR
2018-12-14 16:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837168  13 58466 60354645 A  ERRORERROR'
2018-12-14 16:45:54 [DEBUG   ] Got command RPT from MCS: ref #837169
2018-12-14 16:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837169  77 58466 60354646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:46:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 16:46:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:46:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 16:46:28 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-12-14 16:46:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:46:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:46:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:46:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:46:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:46:28 [DEBUG   ] Finished updating board flags in 1.634 seconds
2018-12-14 16:46:48 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-12-14 16:47:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 16:47:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:47:28 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-12-14 16:47:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:47:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:47:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:47:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:47:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:47:28 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-12-14 16:47:48 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-12-14 16:48:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 16:48:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:48:28 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2018-12-14 16:48:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:48:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:48:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:48:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:48:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:48:28 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-14 16:48:49 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2018-12-14 16:49:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 16:49:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:49:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:49:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:49:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:49:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:49:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:49:28 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-12-14 16:49:29 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-14 16:49:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 16:50:00 [DEBUG   ] Got command RPT from MCS: ref #837191
2018-12-14 16:50:00 [DEBUG   ] summary = ERROR
2018-12-14 16:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837191  13 58466 60600157 A  ERRORERROR'
2018-12-14 16:50:00 [DEBUG   ] Got command RPT from MCS: ref #837192
2018-12-14 16:50:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837192  77 58466 60600361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:50:00 [DEBUG   ] Got command RPT from MCS: ref #837193
2018-12-14 16:50:00 [DEBUG   ] summary = ERROR
2018-12-14 16:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837193  13 58466 60600565 A  ERRORERROR'
2018-12-14 16:50:00 [DEBUG   ] Got command RPT from MCS: ref #837195
2018-12-14 16:50:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837195  77 58466 60600757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:50:00 [DEBUG   ] Got command RPT from MCS: ref #837197
2018-12-14 16:50:00 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837197  12 58466 60600961 A  ERRORB–™š'
2018-12-14 16:50:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 16:50:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:50:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:50:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:50:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:50:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:50:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:50:28 [DEBUG   ] Finished updating board flags in 1.453 seconds
2018-12-14 16:50:29 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 16:50:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 16:50:54 [DEBUG   ] Got command RPT from MCS: ref #837205
2018-12-14 16:50:54 [DEBUG   ] summary = ERROR
2018-12-14 16:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837205  13 58466 60654645 A  ERRORERROR'
2018-12-14 16:50:54 [DEBUG   ] Got command RPT from MCS: ref #837206
2018-12-14 16:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837206  77 58466 60654646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:51:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 16:51:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:51:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 16:51:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:51:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:51:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:51:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:51:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:51:28 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-12-14 16:51:29 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-12-14 16:51:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 16:52:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 16:52:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:52:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:52:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:52:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:52:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:52:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:52:28 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-12-14 16:52:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 16:52:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 16:53:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 16:53:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:53:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:53:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:53:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:53:28 [WARNING ] (13, 1, 'bot')
2018-12-14 16:53:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:53:28 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-12-14 16:53:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 16:53:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 16:54:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 16:54:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:54:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:54:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:54:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:54:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:54:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:54:29 [DEBUG   ] Finished updating board flags in 2.285 seconds
2018-12-14 16:54:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 16:54:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 16:55:00 [DEBUG   ] Got command RPT from MCS: ref #837226
2018-12-14 16:55:00 [DEBUG   ] summary = ERROR
2018-12-14 16:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837226  13 58466 60900241 A  ERRORERROR'
2018-12-14 16:55:00 [DEBUG   ] Got command RPT from MCS: ref #837227
2018-12-14 16:55:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837227  77 58466 60900445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:55:00 [DEBUG   ] Got command RPT from MCS: ref #837228
2018-12-14 16:55:00 [DEBUG   ] summary = ERROR
2018-12-14 16:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837228  13 58466 60900649 A  ERRORERROR'
2018-12-14 16:55:00 [DEBUG   ] Got command RPT from MCS: ref #837229
2018-12-14 16:55:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837229  77 58466 60900841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:55:01 [DEBUG   ] Got command RPT from MCS: ref #837230
2018-12-14 16:55:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 16:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837230  12 58466 60901045 A  ERRORB•™š'
2018-12-14 16:55:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 16:55:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:55:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:55:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:55:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:55:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:55:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:55:29 [DEBUG   ] Finished updating board flags in 2.112 seconds
2018-12-14 16:55:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 16:55:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 16:55:54 [DEBUG   ] Got command RPT from MCS: ref #837231
2018-12-14 16:55:54 [DEBUG   ] summary = ERROR
2018-12-14 16:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837231  13 58466 60954645 A  ERRORERROR'
2018-12-14 16:55:54 [DEBUG   ] Got command RPT from MCS: ref #837232
2018-12-14 16:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 16:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837232  77 58466 60954646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 16:56:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 16:56:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:56:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 16:56:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:56:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:56:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:56:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:56:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:56:29 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-12-14 16:56:30 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-14 16:56:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 16:57:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 16:57:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:57:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:57:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:57:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:57:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:57:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:57:29 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-12-14 16:57:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 16:57:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 16:58:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 16:58:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:58:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 16:58:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:58:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:58:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:58:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:58:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:58:29 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-12-14 16:58:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 16:58:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 16:59:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 16:59:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 16:59:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:59:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:59:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:59:29 [WARNING ] (13, 1, 'bot')
2018-12-14 16:59:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 16:59:29 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-12-14 16:59:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 16:59:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:00:00 [DEBUG   ] Got command RPT from MCS: ref #837258
2018-12-14 17:00:00 [DEBUG   ] summary = ERROR
2018-12-14 17:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837258  13 58466 61200318 A  ERRORERROR'
2018-12-14 17:00:00 [DEBUG   ] Got command RPT from MCS: ref #837259
2018-12-14 17:00:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837259  77 58466 61200521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:00:00 [DEBUG   ] Got command RPT from MCS: ref #837260
2018-12-14 17:00:00 [DEBUG   ] summary = ERROR
2018-12-14 17:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837260  13 58466 61200725 A  ERRORERROR'
2018-12-14 17:00:00 [DEBUG   ] Got command RPT from MCS: ref #837262
2018-12-14 17:00:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837262  77 58466 61200918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:00:01 [DEBUG   ] Got command RPT from MCS: ref #837263
2018-12-14 17:00:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837263  12 58466 61201121 A  ERRORB•™š'
2018-12-14 17:00:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:00:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:00:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:00:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:00:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:00:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:00:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:00:29 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-12-14 17:00:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:00:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 17:00:54 [DEBUG   ] Got command RPT from MCS: ref #837268
2018-12-14 17:00:54 [DEBUG   ] summary = ERROR
2018-12-14 17:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837268  13 58466 61254653 A  ERRORERROR'
2018-12-14 17:00:54 [DEBUG   ] Got command RPT from MCS: ref #837269
2018-12-14 17:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837269  77 58466 61254654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:01:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 17:01:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:01:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:01:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:01:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:01:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:01:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:01:29 [DEBUG   ] Finished updating board flags in 1.669 seconds
2018-12-14 17:01:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:01:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:02:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 17:02:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:02:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 17:02:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:02:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:02:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:02:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:02:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:02:29 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-12-14 17:02:31 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-12-14 17:02:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:03:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:03:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:03:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 17:03:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:03:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:03:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:03:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:03:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:03:29 [DEBUG   ] Finished updating board flags in 1.481 seconds
2018-12-14 17:03:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 17:03:51 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-12-14 17:04:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 17:04:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:04:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:04:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:04:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:04:29 [WARNING ] (13, 1, 'bot')
2018-12-14 17:04:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:04:29 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-12-14 17:04:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 17:04:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 17:05:00 [DEBUG   ] Got command RPT from MCS: ref #837289
2018-12-14 17:05:00 [DEBUG   ] summary = ERROR
2018-12-14 17:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837289  13 58466 61500405 A  ERRORERROR'
2018-12-14 17:05:00 [DEBUG   ] Got command RPT from MCS: ref #837290
2018-12-14 17:05:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837290  77 58466 61500609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:05:00 [DEBUG   ] Got command RPT from MCS: ref #837291
2018-12-14 17:05:00 [DEBUG   ] summary = ERROR
2018-12-14 17:05:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837291  13 58466 61500801 A  ERRORERROR'
2018-12-14 17:05:01 [DEBUG   ] Got command RPT from MCS: ref #837292
2018-12-14 17:05:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837292  77 58466 61501005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:05:01 [DEBUG   ] Got command RPT from MCS: ref #837293
2018-12-14 17:05:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837293  12 58466 61501209 A  ERRORB–™š'
2018-12-14 17:05:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 17:05:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:05:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 17:05:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:05:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:05:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:05:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:05:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:05:30 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-12-14 17:05:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 17:05:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 17:05:54 [DEBUG   ] Got command RPT from MCS: ref #837298
2018-12-14 17:05:54 [DEBUG   ] summary = ERROR
2018-12-14 17:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837298  13 58466 61554657 A  ERRORERROR'
2018-12-14 17:05:54 [DEBUG   ] Got command RPT from MCS: ref #837299
2018-12-14 17:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837299  77 58466 61554658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:06:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 17:06:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:06:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:06:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:06:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:06:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:06:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:06:30 [DEBUG   ] Finished updating board flags in 2.135 seconds
2018-12-14 17:06:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:06:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:07:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 17:07:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:07:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:07:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:07:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:07:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:07:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:07:30 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-12-14 17:07:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 17:07:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 17:08:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:08:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:08:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:08:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:08:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:08:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:08:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:08:30 [DEBUG   ] Finished updating board flags in 1.894 seconds
2018-12-14 17:08:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 17:08:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:09:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:09:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:09:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 17:09:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:09:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:09:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:09:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:09:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:09:30 [DEBUG   ] Finished updating board flags in 1.859 seconds
2018-12-14 17:09:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 17:09:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 17:10:00 [DEBUG   ] Got command RPT from MCS: ref #837321
2018-12-14 17:10:00 [DEBUG   ] summary = ERROR
2018-12-14 17:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837321  13 58466 61800485 A  ERRORERROR'
2018-12-14 17:10:00 [DEBUG   ] Got command RPT from MCS: ref #837322
2018-12-14 17:10:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837322  77 58466 61800689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:10:00 [DEBUG   ] Got command RPT from MCS: ref #837323
2018-12-14 17:10:00 [DEBUG   ] summary = ERROR
2018-12-14 17:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837323  13 58466 61800881 A  ERRORERROR'
2018-12-14 17:10:01 [DEBUG   ] Got command RPT from MCS: ref #837325
2018-12-14 17:10:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837325  77 58466 61801085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:10:01 [DEBUG   ] Got command RPT from MCS: ref #837326
2018-12-14 17:10:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837326  12 58466 61801289 A  ERRORB•™š'
2018-12-14 17:10:12 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-12-14 17:10:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:10:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:10:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:10:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:10:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:10:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:10:30 [DEBUG   ] Finished updating board flags in 1.750 seconds
2018-12-14 17:10:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 17:10:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 17:10:54 [DEBUG   ] Got command RPT from MCS: ref #837331
2018-12-14 17:10:54 [DEBUG   ] summary = ERROR
2018-12-14 17:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837331  13 58466 61854657 A  ERRORERROR'
2018-12-14 17:10:54 [DEBUG   ] Got command RPT from MCS: ref #837332
2018-12-14 17:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837332  77 58466 61854658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:11:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 17:11:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:11:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:11:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:11:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:11:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:11:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:11:30 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-14 17:11:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 17:11:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 17:12:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 17:12:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:12:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:12:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:12:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:12:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:12:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:12:30 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-12-14 17:12:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 17:12:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 17:13:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 17:13:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:13:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 17:13:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:13:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:13:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:13:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:13:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:13:30 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-12-14 17:13:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 17:13:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 17:14:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:14:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:14:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:14:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:14:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:14:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:14:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:14:30 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-12-14 17:14:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 17:14:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 17:15:00 [DEBUG   ] Got command RPT from MCS: ref #837356
2018-12-14 17:15:00 [DEBUG   ] summary = ERROR
2018-12-14 17:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837356  13 58466 62100565 A  ERRORERROR'
2018-12-14 17:15:00 [DEBUG   ] Got command RPT from MCS: ref #837357
2018-12-14 17:15:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837357  77 58466 62100769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:15:00 [DEBUG   ] Got command RPT from MCS: ref #837358
2018-12-14 17:15:00 [DEBUG   ] summary = ERROR
2018-12-14 17:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837358  13 58466 62100973 A  ERRORERROR'
2018-12-14 17:15:01 [DEBUG   ] Got command RPT from MCS: ref #837359
2018-12-14 17:15:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837359  77 58466 62101165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:15:01 [DEBUG   ] Got command RPT from MCS: ref #837360
2018-12-14 17:15:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837360  12 58466 62101369 A  ERRORB”™š'
2018-12-14 17:15:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 17:15:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:15:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 17:15:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:15:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:15:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:15:30 [WARNING ] (13, 1, 'bot')
2018-12-14 17:15:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:15:30 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-12-14 17:15:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:15:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:15:54 [DEBUG   ] Got command RPT from MCS: ref #837361
2018-12-14 17:15:54 [DEBUG   ] summary = ERROR
2018-12-14 17:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837361  13 58466 62154649 A  ERRORERROR'
2018-12-14 17:15:54 [DEBUG   ] Got command RPT from MCS: ref #837362
2018-12-14 17:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837362  77 58466 62154650 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:16:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 17:16:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:16:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:16:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:16:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:16:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:16:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:16:31 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-12-14 17:16:33 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-12-14 17:16:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:17:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 17:17:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:17:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:17:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:17:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:17:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:17:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:17:31 [DEBUG   ] Finished updating board flags in 2.194 seconds
2018-12-14 17:17:33 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 17:17:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 17:18:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 17:18:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:18:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:18:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:18:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:18:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:18:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:18:31 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-12-14 17:18:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 17:18:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 17:19:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 17:19:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:19:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:19:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:19:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:19:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:19:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:19:31 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-12-14 17:19:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 17:19:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 17:20:00 [DEBUG   ] Got command RPT from MCS: ref #837384
2018-12-14 17:20:00 [DEBUG   ] summary = ERROR
2018-12-14 17:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837384  13 58466 62400645 A  ERRORERROR'
2018-12-14 17:20:00 [DEBUG   ] Got command RPT from MCS: ref #837385
2018-12-14 17:20:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837385  77 58466 62400849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:20:01 [DEBUG   ] Got command RPT from MCS: ref #837386
2018-12-14 17:20:01 [DEBUG   ] summary = ERROR
2018-12-14 17:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837386  13 58466 62401041 A  ERRORERROR'
2018-12-14 17:20:01 [DEBUG   ] Got command RPT from MCS: ref #837388
2018-12-14 17:20:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837388  77 58466 62401249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:20:01 [DEBUG   ] Got command RPT from MCS: ref #837389
2018-12-14 17:20:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837389  12 58466 62401453 A  ERRORB–™š'
2018-12-14 17:20:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 17:20:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:20:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:20:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:20:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:20:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:20:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:20:31 [DEBUG   ] Finished updating board flags in 1.835 seconds
2018-12-14 17:20:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 17:20:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 17:20:54 [DEBUG   ] Got command RPT from MCS: ref #837398
2018-12-14 17:20:54 [DEBUG   ] summary = ERROR
2018-12-14 17:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837398  13 58466 62454661 A  ERRORERROR'
2018-12-14 17:20:54 [DEBUG   ] Got command RPT from MCS: ref #837399
2018-12-14 17:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837399  77 58466 62454662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:21:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 17:21:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 17:21:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:21:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 17:21:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:21:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:21:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:21:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:21:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:21:31 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-14 17:21:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 17:21:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:22:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 17:22:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:22:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:22:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:22:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:22:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:22:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:22:31 [DEBUG   ] Finished updating board flags in 1.756 seconds
2018-12-14 17:22:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 17:22:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 17:23:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 17:23:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 17:23:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:23:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:23:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:23:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:23:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:23:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:23:31 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-12-14 17:23:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 17:23:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 17:24:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-14 17:24:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:24:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 17:24:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 17:24:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:24:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:24:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:24:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:24:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:24:31 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-12-14 17:24:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:24:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 17:25:00 [DEBUG   ] Got command RPT from MCS: ref #837419
2018-12-14 17:25:00 [DEBUG   ] summary = ERROR
2018-12-14 17:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837419  13 58466 62700725 A  ERRORERROR'
2018-12-14 17:25:00 [DEBUG   ] Got command RPT from MCS: ref #837420
2018-12-14 17:25:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837420  77 58466 62700929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:25:01 [DEBUG   ] Got command RPT from MCS: ref #837421
2018-12-14 17:25:01 [DEBUG   ] summary = ERROR
2018-12-14 17:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837421  13 58466 62701133 A  ERRORERROR'
2018-12-14 17:25:01 [DEBUG   ] Got command RPT from MCS: ref #837422
2018-12-14 17:25:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837422  77 58466 62701326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:25:01 [DEBUG   ] Got command RPT from MCS: ref #837423
2018-12-14 17:25:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837423  12 58466 62701529 A  ERRORB–™š'
2018-12-14 17:25:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 17:25:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:25:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:25:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:25:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:25:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:25:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:25:31 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-14 17:25:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:25:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:25:54 [DEBUG   ] Got command RPT from MCS: ref #837424
2018-12-14 17:25:54 [DEBUG   ] summary = ERROR
2018-12-14 17:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837424  13 58466 62754653 A  ERRORERROR'
2018-12-14 17:25:54 [DEBUG   ] Got command RPT from MCS: ref #837425
2018-12-14 17:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837425  77 58466 62754654 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:26:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 17:26:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:26:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:26:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:26:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:26:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:26:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:26:31 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-14 17:26:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 17:26:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 17:27:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:27:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:27:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 17:27:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:27:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:27:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:27:31 [WARNING ] (13, 1, 'bot')
2018-12-14 17:27:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:27:31 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-12-14 17:27:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 17:27:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 17:28:14 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-14 17:28:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:28:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:28:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:28:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:28:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:28:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:28:32 [DEBUG   ] Finished updating board flags in 2.222 seconds
2018-12-14 17:28:35 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-14 17:28:54 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 17:29:15 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-14 17:29:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:29:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:29:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:29:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:29:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:29:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:29:32 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-12-14 17:29:35 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 17:29:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 17:30:00 [DEBUG   ] Got command RPT from MCS: ref #837451
2018-12-14 17:30:00 [DEBUG   ] summary = ERROR
2018-12-14 17:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837451  13 58466 63000809 A  ERRORERROR'
2018-12-14 17:30:01 [DEBUG   ] Got command RPT from MCS: ref #837452
2018-12-14 17:30:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837452  77 58466 63001001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:30:01 [DEBUG   ] Got command RPT from MCS: ref #837453
2018-12-14 17:30:01 [DEBUG   ] summary = ERROR
2018-12-14 17:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837453  13 58466 63001205 A  ERRORERROR'
2018-12-14 17:30:01 [DEBUG   ] Got command RPT from MCS: ref #837455
2018-12-14 17:30:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837455  77 58466 63001409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:30:01 [DEBUG   ] Got command RPT from MCS: ref #837456
2018-12-14 17:30:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837456  12 58466 63001613 A  ERRORB”™š'
2018-12-14 17:30:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 17:30:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:30:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:30:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:30:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:30:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:30:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:30:32 [DEBUG   ] Finished updating board flags in 2.154 seconds
2018-12-14 17:30:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:30:54 [DEBUG   ] Got command RPT from MCS: ref #837461
2018-12-14 17:30:54 [DEBUG   ] summary = ERROR
2018-12-14 17:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837461  13 58466 63054657 A  ERRORERROR'
2018-12-14 17:30:54 [DEBUG   ] Got command RPT from MCS: ref #837462
2018-12-14 17:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837462  77 58466 63054658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:30:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:31:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 17:31:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:31:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:31:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:31:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:31:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:31:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:31:32 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-12-14 17:31:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 17:31:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:32:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 17:32:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:32:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:32:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:32:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:32:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:32:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:32:32 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-12-14 17:32:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 17:32:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 17:33:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:33:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:33:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 17:33:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:33:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:33:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:33:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:33:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:33:32 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-12-14 17:33:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 17:33:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 17:34:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 17:34:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:34:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:34:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:34:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:34:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:34:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:34:32 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-14 17:34:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 17:34:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 17:35:00 [DEBUG   ] Got command RPT from MCS: ref #837482
2018-12-14 17:35:00 [DEBUG   ] summary = ERROR
2018-12-14 17:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837482  13 58466 63300889 A  ERRORERROR'
2018-12-14 17:35:01 [DEBUG   ] Got command RPT from MCS: ref #837483
2018-12-14 17:35:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837483  77 58466 63301093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:35:01 [DEBUG   ] Got command RPT from MCS: ref #837484
2018-12-14 17:35:01 [DEBUG   ] summary = ERROR
2018-12-14 17:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837484  13 58466 63301285 A  ERRORERROR'
2018-12-14 17:35:01 [DEBUG   ] Got command RPT from MCS: ref #837485
2018-12-14 17:35:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837485  77 58466 63301489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:35:01 [DEBUG   ] Got command RPT from MCS: ref #837486
2018-12-14 17:35:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837486  12 58466 63301693 A  ERRORB”™š'
2018-12-14 17:35:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 17:35:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:35:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:35:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:35:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:35:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:35:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:35:32 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-14 17:35:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:35:54 [DEBUG   ] Got command RPT from MCS: ref #837491
2018-12-14 17:35:54 [DEBUG   ] summary = ERROR
2018-12-14 17:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837491  13 58466 63354661 A  ERRORERROR'
2018-12-14 17:35:54 [DEBUG   ] Got command RPT from MCS: ref #837492
2018-12-14 17:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837492  77 58466 63354662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:35:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 17:36:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 17:36:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:36:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:36:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:36:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:36:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:36:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:36:32 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-12-14 17:36:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 17:36:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 17:37:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 17:37:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:37:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:37:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:37:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:37:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:37:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:37:32 [DEBUG   ] Finished updating board flags in 1.639 seconds
2018-12-14 17:37:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 17:37:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:38:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:38:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:38:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:38:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:38:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:38:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:38:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:38:32 [DEBUG   ] Finished updating board flags in 1.555 seconds
2018-12-14 17:38:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 17:38:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 17:39:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:39:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:39:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:39:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:39:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:39:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:39:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:39:32 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-12-14 17:39:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:39:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 17:40:00 [DEBUG   ] Got command RPT from MCS: ref #837514
2018-12-14 17:40:00 [DEBUG   ] summary = ERROR
2018-12-14 17:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837514  13 58466 63600969 A  ERRORERROR'
2018-12-14 17:40:01 [DEBUG   ] Got command RPT from MCS: ref #837515
2018-12-14 17:40:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:40:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837515  77 58466 63601173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:40:01 [DEBUG   ] Got command RPT from MCS: ref #837516
2018-12-14 17:40:01 [DEBUG   ] summary = ERROR
2018-12-14 17:40:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837516  13 58466 63601377 A  ERRORERROR'
2018-12-14 17:40:01 [DEBUG   ] Got command RPT from MCS: ref #837518
2018-12-14 17:40:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:40:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837518  77 58466 63601569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:40:01 [DEBUG   ] Got command RPT from MCS: ref #837519
2018-12-14 17:40:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:40:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837519  12 58466 63601773 A  ERRORB–™š'
2018-12-14 17:40:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 17:40:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:40:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:40:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:40:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:40:32 [WARNING ] (13, 1, 'bot')
2018-12-14 17:40:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:40:32 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-12-14 17:40:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 17:40:54 [DEBUG   ] Got command RPT from MCS: ref #837524
2018-12-14 17:40:54 [DEBUG   ] summary = ERROR
2018-12-14 17:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837524  13 58466 63654657 A  ERRORERROR'
2018-12-14 17:40:54 [DEBUG   ] Got command RPT from MCS: ref #837525
2018-12-14 17:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837525  77 58466 63654658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:40:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:41:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:41:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:41:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:41:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:41:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:41:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:41:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:41:33 [DEBUG   ] Finished updating board flags in 2.295 seconds
2018-12-14 17:41:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 17:41:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 17:42:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 17:42:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-12-14 17:42:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:42:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:42:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:42:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:42:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:42:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:42:33 [DEBUG   ] Finished updating board flags in 2.110 seconds
2018-12-14 17:42:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 17:42:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 17:43:17 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-14 17:43:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:43:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 17:43:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:43:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:43:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:43:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:43:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:43:33 [DEBUG   ] Finished updating board flags in 2.020 seconds
2018-12-14 17:43:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 17:43:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 17:44:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 17:44:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:44:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 17:44:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:44:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:44:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:44:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:44:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:44:33 [DEBUG   ] Finished updating board flags in 1.965 seconds
2018-12-14 17:44:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 17:44:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 17:45:01 [DEBUG   ] Got command RPT from MCS: ref #837549
2018-12-14 17:45:01 [DEBUG   ] summary = ERROR
2018-12-14 17:45:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837549  13 58466 63901057 A  ERRORERROR'
2018-12-14 17:45:01 [DEBUG   ] Got command RPT from MCS: ref #837550
2018-12-14 17:45:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:45:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837550  77 58466 63901249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:45:01 [DEBUG   ] Got command RPT from MCS: ref #837551
2018-12-14 17:45:01 [DEBUG   ] summary = ERROR
2018-12-14 17:45:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837551  13 58466 63901453 A  ERRORERROR'
2018-12-14 17:45:01 [DEBUG   ] Got command RPT from MCS: ref #837552
2018-12-14 17:45:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:45:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837552  77 58466 63901657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:45:01 [DEBUG   ] Got command RPT from MCS: ref #837553
2018-12-14 17:45:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:45:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837553  12 58466 63901861 A  ERRORB•™š'
2018-12-14 17:45:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 17:45:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:45:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:45:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:45:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:45:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:45:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:45:33 [DEBUG   ] Finished updating board flags in 1.833 seconds
2018-12-14 17:45:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 17:45:54 [DEBUG   ] Got command RPT from MCS: ref #837554
2018-12-14 17:45:54 [DEBUG   ] summary = ERROR
2018-12-14 17:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837554  13 58466 63954661 A  ERRORERROR'
2018-12-14 17:45:54 [DEBUG   ] Got command RPT from MCS: ref #837555
2018-12-14 17:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837555  77 58466 63954662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:45:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:46:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:46:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:46:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:46:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:46:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:46:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:46:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:46:33 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-12-14 17:46:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 17:46:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:47:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:47:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:47:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:47:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:47:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:47:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:47:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:47:33 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-14 17:47:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:47:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 17:48:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 17:48:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:48:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:48:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:48:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:48:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:48:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:48:33 [DEBUG   ] Finished updating board flags in 1.656 seconds
2018-12-14 17:48:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:48:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:49:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 17:49:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:49:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:49:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:49:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:49:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:49:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:49:33 [DEBUG   ] Finished updating board flags in 1.540 seconds
2018-12-14 17:49:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 17:49:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:50:01 [DEBUG   ] Got command RPT from MCS: ref #837577
2018-12-14 17:50:01 [DEBUG   ] summary = ERROR
2018-12-14 17:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837577  13 58466 64201137 A  ERRORERROR'
2018-12-14 17:50:01 [DEBUG   ] Got command RPT from MCS: ref #837578
2018-12-14 17:50:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837578  77 58466 64201329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:50:01 [DEBUG   ] Got command RPT from MCS: ref #837579
2018-12-14 17:50:01 [DEBUG   ] summary = ERROR
2018-12-14 17:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837579  13 58466 64201533 A  ERRORERROR'
2018-12-14 17:50:01 [DEBUG   ] Got command RPT from MCS: ref #837581
2018-12-14 17:50:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837581  77 58466 64201737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:50:01 [DEBUG   ] Got command RPT from MCS: ref #837583
2018-12-14 17:50:01 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:50:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837583  12 58466 64201941 A  ERRORB”™š'
2018-12-14 17:50:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:50:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 17:50:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:50:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:50:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:50:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:50:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:50:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:50:33 [DEBUG   ] Finished updating board flags in 1.479 seconds
2018-12-14 17:50:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 17:50:54 [DEBUG   ] Got command RPT from MCS: ref #837591
2018-12-14 17:50:54 [DEBUG   ] summary = ERROR
2018-12-14 17:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837591  13 58466 64254665 A  ERRORERROR'
2018-12-14 17:50:54 [DEBUG   ] Got command RPT from MCS: ref #837592
2018-12-14 17:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837592  77 58466 64254666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:50:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 17:51:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:51:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:51:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:51:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:51:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:51:33 [WARNING ] (13, 1, 'bot')
2018-12-14 17:51:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:51:33 [DEBUG   ] Finished updating board flags in 1.526 seconds
2018-12-14 17:51:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 17:51:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 17:52:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 17:52:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:52:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-14 17:52:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:52:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:52:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:52:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:52:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:52:34 [DEBUG   ] Finished updating board flags in 2.260 seconds
2018-12-14 17:52:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:52:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 17:53:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 17:53:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:53:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:53:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:53:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:53:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:53:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:53:34 [DEBUG   ] Finished updating board flags in 2.121 seconds
2018-12-14 17:53:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 17:53:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:54:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 17:54:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:54:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:54:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:54:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:54:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:54:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:54:34 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-12-14 17:54:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 17:54:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 17:55:01 [DEBUG   ] Got command RPT from MCS: ref #837612
2018-12-14 17:55:01 [DEBUG   ] summary = ERROR
2018-12-14 17:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837612  13 58466 64501213 A  ERRORERROR'
2018-12-14 17:55:01 [DEBUG   ] Got command RPT from MCS: ref #837613
2018-12-14 17:55:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837613  77 58466 64501417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:55:01 [DEBUG   ] Got command RPT from MCS: ref #837614
2018-12-14 17:55:01 [DEBUG   ] summary = ERROR
2018-12-14 17:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837614  13 58466 64501622 A  ERRORERROR'
2018-12-14 17:55:01 [DEBUG   ] Got command RPT from MCS: ref #837615
2018-12-14 17:55:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837615  77 58466 64501825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:55:02 [DEBUG   ] Got command RPT from MCS: ref #837616
2018-12-14 17:55:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 17:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837616  12 58466 64502017 A  ERRORB–™š'
2018-12-14 17:55:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 17:55:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:55:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:55:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:55:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:55:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:55:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:55:34 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-12-14 17:55:38 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 17:55:54 [DEBUG   ] Got command RPT from MCS: ref #837617
2018-12-14 17:55:54 [DEBUG   ] summary = ERROR
2018-12-14 17:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837617  13 58466 64554657 A  ERRORERROR'
2018-12-14 17:55:54 [DEBUG   ] Got command RPT from MCS: ref #837618
2018-12-14 17:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 17:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837618  77 58466 64554658 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 17:55:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 17:56:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 17:56:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:56:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:56:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:56:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:56:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:56:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:56:34 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-12-14 17:56:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 17:56:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 17:57:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 17:57:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:57:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:57:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:57:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:57:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:57:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:57:34 [DEBUG   ] Finished updating board flags in 1.849 seconds
2018-12-14 17:57:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 17:57:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 17:58:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 17:58:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:58:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:58:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:58:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:58:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:58:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:58:34 [DEBUG   ] Finished updating board flags in 1.754 seconds
2018-12-14 17:58:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:58:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:59:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 17:59:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 17:59:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:59:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:59:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:59:34 [WARNING ] (13, 1, 'bot')
2018-12-14 17:59:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 17:59:34 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-12-14 17:59:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 17:59:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 18:00:01 [DEBUG   ] Got command RPT from MCS: ref #837644
2018-12-14 18:00:01 [DEBUG   ] summary = ERROR
2018-12-14 18:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837644  13 58466 64801293 A  ERRORERROR'
2018-12-14 18:00:01 [DEBUG   ] Got command RPT from MCS: ref #837645
2018-12-14 18:00:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837645  77 58466 64801497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:00:01 [DEBUG   ] Got command RPT from MCS: ref #837646
2018-12-14 18:00:01 [DEBUG   ] summary = ERROR
2018-12-14 18:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837646  13 58466 64801701 A  ERRORERROR'
2018-12-14 18:00:01 [DEBUG   ] Got command RPT from MCS: ref #837648
2018-12-14 18:00:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:00:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837648  77 58466 64801906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:00:02 [DEBUG   ] Got command RPT from MCS: ref #837649
2018-12-14 18:00:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837649  12 58466 64802097 A  ERRORB•™š'
2018-12-14 18:00:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:00:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:00:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:00:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:00:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:00:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:00:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:00:34 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-12-14 18:00:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:00:54 [DEBUG   ] Got command RPT from MCS: ref #837654
2018-12-14 18:00:54 [DEBUG   ] summary = ERROR
2018-12-14 18:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837654  13 58466 64854669 A  ERRORERROR'
2018-12-14 18:00:54 [DEBUG   ] Got command RPT from MCS: ref #837655
2018-12-14 18:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837655  77 58466 64854670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:00:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:01:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:01:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:01:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:01:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:01:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:01:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:01:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:01:34 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-12-14 18:01:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:01:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:02:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 18:02:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:02:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:02:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:02:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:02:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:02:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:02:34 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-14 18:02:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 18:02:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:03:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:03:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:03:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:03:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:03:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:03:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:03:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:03:34 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-12-14 18:03:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:03:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:04:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:04:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:04:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:04:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:04:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:04:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:04:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:04:34 [DEBUG   ] Finished updating board flags in 1.547 seconds
2018-12-14 18:04:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 18:04:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 18:05:01 [DEBUG   ] Got command RPT from MCS: ref #837675
2018-12-14 18:05:01 [DEBUG   ] summary = ERROR
2018-12-14 18:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837675  13 58466 65101377 A  ERRORERROR'
2018-12-14 18:05:01 [DEBUG   ] Got command RPT from MCS: ref #837676
2018-12-14 18:05:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837676  77 58466 65101581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:05:01 [DEBUG   ] Got command RPT from MCS: ref #837677
2018-12-14 18:05:01 [DEBUG   ] summary = ERROR
2018-12-14 18:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837677  13 58466 65101773 A  ERRORERROR'
2018-12-14 18:05:01 [DEBUG   ] Got command RPT from MCS: ref #837678
2018-12-14 18:05:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:05:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837678  77 58466 65101977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:05:02 [DEBUG   ] Got command RPT from MCS: ref #837679
2018-12-14 18:05:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837679  12 58466 65102181 A  ERRORB”™š'
2018-12-14 18:05:18 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-14 18:05:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:05:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:05:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:05:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:05:34 [WARNING ] (13, 1, 'bot')
2018-12-14 18:05:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:05:34 [DEBUG   ] Finished updating board flags in 1.551 seconds
2018-12-14 18:05:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 18:05:54 [DEBUG   ] Got command RPT from MCS: ref #837684
2018-12-14 18:05:54 [DEBUG   ] summary = ERROR
2018-12-14 18:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837684  13 58466 65154669 A  ERRORERROR'
2018-12-14 18:05:54 [DEBUG   ] Got command RPT from MCS: ref #837685
2018-12-14 18:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837685  77 58466 65154670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:05:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 18:06:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 18:06:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:06:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:06:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:06:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:06:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:06:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:06:35 [DEBUG   ] Finished updating board flags in 2.147 seconds
2018-12-14 18:06:38 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-14 18:06:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 18:07:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 18:07:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:07:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:07:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:07:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:07:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:07:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:07:35 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-12-14 18:07:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 18:07:58 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-14 18:08:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 18:08:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 18:08:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:08:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:08:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:08:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:08:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:08:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:08:35 [DEBUG   ] Finished updating board flags in 1.923 seconds
2018-12-14 18:08:39 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 18:08:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 18:09:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:09:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 18:09:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:09:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:09:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:09:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:09:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:09:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:09:35 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-12-14 18:09:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 18:09:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 18:10:01 [DEBUG   ] Got command RPT from MCS: ref #837707
2018-12-14 18:10:01 [DEBUG   ] summary = ERROR
2018-12-14 18:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837707  13 58466 65401454 A  ERRORERROR'
2018-12-14 18:10:01 [DEBUG   ] Got command RPT from MCS: ref #837708
2018-12-14 18:10:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837708  77 58466 65401657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:10:01 [DEBUG   ] Got command RPT from MCS: ref #837709
2018-12-14 18:10:01 [DEBUG   ] summary = ERROR
2018-12-14 18:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837709  13 58466 65401861 A  ERRORERROR'
2018-12-14 18:10:02 [DEBUG   ] Got command RPT from MCS: ref #837711
2018-12-14 18:10:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837711  77 58466 65402065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:10:02 [DEBUG   ] Got command RPT from MCS: ref #837712
2018-12-14 18:10:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837712  12 58466 65402257 A  ERRORB–™š'
2018-12-14 18:10:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:10:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:10:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 18:10:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:10:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:10:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:10:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:10:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:10:35 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-12-14 18:10:39 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 18:10:54 [DEBUG   ] Got command RPT from MCS: ref #837717
2018-12-14 18:10:54 [DEBUG   ] summary = ERROR
2018-12-14 18:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837717  13 58466 65454661 A  ERRORERROR'
2018-12-14 18:10:54 [DEBUG   ] Got command RPT from MCS: ref #837718
2018-12-14 18:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837718  77 58466 65454662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:10:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 18:11:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 18:11:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 18:11:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:11:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 18:11:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:11:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:11:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:11:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:11:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:11:35 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-14 18:11:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 18:11:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 18:12:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 18:12:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:12:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:12:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:12:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:12:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:12:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:12:35 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-12-14 18:12:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 18:13:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 18:13:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 18:13:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:13:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:13:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:13:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:13:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:13:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:13:35 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-14 18:13:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 18:14:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:14:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:14:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:14:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:14:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:14:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:14:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:14:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:14:35 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-12-14 18:14:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 18:15:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:15:01 [DEBUG   ] Got command RPT from MCS: ref #837742
2018-12-14 18:15:01 [DEBUG   ] summary = ERROR
2018-12-14 18:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837742  13 58466 65701545 A  ERRORERROR'
2018-12-14 18:15:01 [DEBUG   ] Got command RPT from MCS: ref #837743
2018-12-14 18:15:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837743  77 58466 65701737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:15:01 [DEBUG   ] Got command RPT from MCS: ref #837744
2018-12-14 18:15:01 [DEBUG   ] summary = ERROR
2018-12-14 18:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837744  13 58466 65701941 A  ERRORERROR'
2018-12-14 18:15:02 [DEBUG   ] Got command RPT from MCS: ref #837745
2018-12-14 18:15:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837745  77 58466 65702145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:15:02 [DEBUG   ] Got command RPT from MCS: ref #837746
2018-12-14 18:15:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837746  12 58466 65702349 A  ERRORB–™š'
2018-12-14 18:15:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:15:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:15:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:15:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:15:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:15:35 [WARNING ] (13, 1, 'bot')
2018-12-14 18:15:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:15:35 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-12-14 18:15:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:15:54 [DEBUG   ] Got command RPT from MCS: ref #837747
2018-12-14 18:15:54 [DEBUG   ] summary = ERROR
2018-12-14 18:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837747  13 58466 65754661 A  ERRORERROR'
2018-12-14 18:15:54 [DEBUG   ] Got command RPT from MCS: ref #837748
2018-12-14 18:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837748  77 58466 65754662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:16:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 18:16:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:16:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 18:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 18:16:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:16:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:16:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:16:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:16:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:16:36 [DEBUG   ] Finished updating board flags in 2.167 seconds
2018-12-14 18:16:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:17:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:17:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 18:17:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:17:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:17:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:17:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:17:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:17:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:17:36 [DEBUG   ] Finished updating board flags in 1.885 seconds
2018-12-14 18:17:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:18:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:18:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 18:18:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:18:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:18:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:18:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:18:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:18:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:18:36 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-14 18:18:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 18:19:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 18:19:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 18:19:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:19:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:19:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:19:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:19:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:19:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:19:36 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-12-14 18:19:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-14 18:20:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 18:20:01 [DEBUG   ] Got command RPT from MCS: ref #837770
2018-12-14 18:20:01 [DEBUG   ] summary = ERROR
2018-12-14 18:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837770  13 58466 66001621 A  ERRORERROR'
2018-12-14 18:20:01 [DEBUG   ] Got command RPT from MCS: ref #837771
2018-12-14 18:20:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837771  77 58466 66001825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:20:02 [DEBUG   ] Got command RPT from MCS: ref #837772
2018-12-14 18:20:02 [DEBUG   ] summary = ERROR
2018-12-14 18:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837772  13 58466 66002017 A  ERRORERROR'
2018-12-14 18:20:02 [DEBUG   ] Got command RPT from MCS: ref #837774
2018-12-14 18:20:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837774  77 58466 66002221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:20:02 [DEBUG   ] Got command RPT from MCS: ref #837775
2018-12-14 18:20:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837775  12 58466 66002425 A  ERRORB•™š'
2018-12-14 18:20:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 18:20:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:20:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:20:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:20:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:20:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:20:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:20:36 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-12-14 18:20:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 18:20:54 [DEBUG   ] Got command RPT from MCS: ref #837784
2018-12-14 18:20:54 [DEBUG   ] summary = ERROR
2018-12-14 18:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837784  13 58466 66054669 A  ERRORERROR'
2018-12-14 18:20:54 [DEBUG   ] Got command RPT from MCS: ref #837785
2018-12-14 18:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837785  77 58466 66054670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:21:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 18:21:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 18:21:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:21:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:21:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:21:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:21:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:21:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:21:36 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-12-14 18:21:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 18:22:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 18:22:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 18:22:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:22:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:22:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:22:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:22:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:22:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:22:36 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-12-14 18:22:40 [DEBUG   ] Finished updating ant stats in 0.496 seconds
2018-12-14 18:23:01 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 18:23:21 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 18:23:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:23:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:23:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:23:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:23:36 [WARNING ] (13, 1, 'bot')
2018-12-14 18:23:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:23:36 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-12-14 18:23:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:24:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 18:24:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 18:24:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:24:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:24:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:24:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:24:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:24:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:24:37 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-12-14 18:24:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:25:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 18:25:01 [DEBUG   ] Got command RPT from MCS: ref #837805
2018-12-14 18:25:01 [DEBUG   ] summary = ERROR
2018-12-14 18:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837805  13 58466 66301705 A  ERRORERROR'
2018-12-14 18:25:01 [DEBUG   ] Got command RPT from MCS: ref #837806
2018-12-14 18:25:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837806  77 58466 66301897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:25:02 [DEBUG   ] Got command RPT from MCS: ref #837807
2018-12-14 18:25:02 [DEBUG   ] summary = ERROR
2018-12-14 18:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837807  13 58466 66302101 A  ERRORERROR'
2018-12-14 18:25:02 [DEBUG   ] Got command RPT from MCS: ref #837808
2018-12-14 18:25:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837808  77 58466 66302305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:25:02 [DEBUG   ] Got command RPT from MCS: ref #837809
2018-12-14 18:25:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837809  12 58466 66302497 A  ERRORB”™š'
2018-12-14 18:25:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 18:25:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:25:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:25:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:25:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:25:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:25:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:25:37 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-12-14 18:25:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 18:25:54 [DEBUG   ] Got command RPT from MCS: ref #837810
2018-12-14 18:25:54 [DEBUG   ] summary = ERROR
2018-12-14 18:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837810  13 58466 66354673 A  ERRORERROR'
2018-12-14 18:25:54 [DEBUG   ] Got command RPT from MCS: ref #837811
2018-12-14 18:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837811  77 58466 66354674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:26:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-14 18:26:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 18:26:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:26:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:26:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:26:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:26:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:26:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:26:37 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-14 18:26:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 18:27:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 18:27:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 18:27:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:27:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:27:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:27:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:27:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:27:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:27:37 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-14 18:27:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 18:28:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 18:28:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 18:28:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 18:28:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:28:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:28:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:28:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:28:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:28:37 [DEBUG   ] Finished updating board flags in 1.719 seconds
2018-12-14 18:28:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 18:29:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 18:29:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 18:29:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:29:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:29:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:29:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:29:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:29:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:29:37 [DEBUG   ] Finished updating board flags in 1.494 seconds
2018-12-14 18:29:42 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 18:30:01 [DEBUG   ] Got command RPT from MCS: ref #837837
2018-12-14 18:30:01 [DEBUG   ] summary = ERROR
2018-12-14 18:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837837  13 58466 66601786 A  ERRORERROR'
2018-12-14 18:30:01 [DEBUG   ] Got command RPT from MCS: ref #837838
2018-12-14 18:30:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:30:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837838  77 58466 66601977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:30:02 [DEBUG   ] Got command RPT from MCS: ref #837839
2018-12-14 18:30:02 [DEBUG   ] summary = ERROR
2018-12-14 18:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837839  13 58466 66602181 A  ERRORERROR'
2018-12-14 18:30:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 18:30:02 [DEBUG   ] Got command RPT from MCS: ref #837841
2018-12-14 18:30:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837841  77 58466 66602385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:30:02 [DEBUG   ] Got command RPT from MCS: ref #837843
2018-12-14 18:30:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837843  12 58466 66602577 A  ERRORB—™š'
2018-12-14 18:30:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 18:30:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:30:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:30:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:30:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:30:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:30:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:30:37 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-12-14 18:30:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:30:54 [DEBUG   ] Got command RPT from MCS: ref #837847
2018-12-14 18:30:54 [DEBUG   ] summary = ERROR
2018-12-14 18:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837847  13 58466 66654669 A  ERRORERROR'
2018-12-14 18:30:54 [DEBUG   ] Got command RPT from MCS: ref #837848
2018-12-14 18:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837848  77 58466 66654670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:31:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:31:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 18:31:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:31:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:31:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:31:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:31:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:31:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:31:37 [DEBUG   ] Finished updating board flags in 1.476 seconds
2018-12-14 18:31:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:32:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:32:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:32:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:32:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:32:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:32:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:32:37 [WARNING ] (13, 1, 'bot')
2018-12-14 18:32:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:32:37 [DEBUG   ] Finished updating board flags in 1.490 seconds
2018-12-14 18:32:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 18:33:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 18:33:11 [DEBUG   ] Got command TBW from MCS: ref #837869
2018-12-14 18:33:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-12-14 18:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   837869   8 58466 66791630 A  ERROR'
2018-12-14 18:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-12-14 18:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-12-14 18:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-12-14 18:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-12-14 18:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-12-14 18:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-12-14 18:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-12-14 18:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-12-14 18:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-12-14 18:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-12-14 18:33:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-12-14 18:33:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-12-14 18:33:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-12-14 18:33:15 [DEBUG   ] spawn_process: at 2018-12-14 18:33:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-12-14 18:33:15 [INFO    ] Finished spawning TBW
2018-12-14 18:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 18:33:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:33:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:33:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:33:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:33:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:33:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:33:38 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-12-14 18:34:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 18:34:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:34:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:34:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:34:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:34:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:34:38 [DEBUG   ] Finished updating board flags in 2.112 seconds
2018-12-14 18:35:01 [DEBUG   ] Got command RPT from MCS: ref #837874
2018-12-14 18:35:01 [DEBUG   ] summary = ERROR
2018-12-14 18:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837874  13 58466 66901861 A  ERRORERROR'
2018-12-14 18:35:02 [DEBUG   ] Got command RPT from MCS: ref #837875
2018-12-14 18:35:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837875  77 58466 66902065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:35:02 [DEBUG   ] Got command RPT from MCS: ref #837876
2018-12-14 18:35:02 [DEBUG   ] summary = ERROR
2018-12-14 18:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837876  13 58466 66902257 A  ERRORERROR'
2018-12-14 18:35:02 [DEBUG   ] Got command RPT from MCS: ref #837877
2018-12-14 18:35:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837877  77 58466 66902461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:35:02 [DEBUG   ] Got command RPT from MCS: ref #837878
2018-12-14 18:35:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837878  12 58466 66902665 A  ERRORB–™š'
2018-12-14 18:35:03 [INFO    ] __waitForTBW - TBW finished in 108.674 s
2018-12-14 18:35:04 [DEBUG   ] Finished updating ant stats in 0.460 seconds
2018-12-14 18:35:04 [INFO    ] Started antennas statistics background thread
2018-12-14 18:35:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1544812506']
2018-12-14 18:35:04 [DEBUG   ] spawn_process: at 2018-12-14 18:35:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1544812506']
2018-12-14 18:35:04 [INFO    ] Finished spawning TBN in 0.050 s
2018-12-14 18:35:24 [DEBUG   ] Finished updating ant stats in 0.466 seconds
2018-12-14 18:35:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:35:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:35:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:35:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:35:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:35:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:35:38 [DEBUG   ] Finished updating board flags in 2.167 seconds
2018-12-14 18:35:44 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-14 18:35:54 [DEBUG   ] Got command RPT from MCS: ref #837886
2018-12-14 18:35:54 [DEBUG   ] summary = ERROR
2018-12-14 18:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837886  13 58466 66954669 A  ERRORERROR'
2018-12-14 18:35:54 [DEBUG   ] Got command RPT from MCS: ref #837887
2018-12-14 18:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837887  77 58466 66954670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:36:04 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 18:36:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 18:36:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:36:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:36:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:36:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:36:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:36:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:36:38 [DEBUG   ] Finished updating board flags in 1.861 seconds
2018-12-14 18:36:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 18:37:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 18:37:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:37:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:37:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:37:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:37:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:37:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:37:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:37:38 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-12-14 18:37:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:38:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:38:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 18:38:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:38:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:38:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:38:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:38:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:38:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:38:38 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-12-14 18:38:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:39:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:39:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:39:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:39:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:39:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:39:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:39:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:39:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:39:38 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-12-14 18:39:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 18:40:01 [DEBUG   ] Got command RPT from MCS: ref #837909
2018-12-14 18:40:01 [DEBUG   ] summary = ERROR
2018-12-14 18:40:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837909  13 58466 67201937 A  ERRORERROR'
2018-12-14 18:40:02 [DEBUG   ] Got command RPT from MCS: ref #837910
2018-12-14 18:40:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837910  77 58466 67202141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:40:02 [DEBUG   ] Got command RPT from MCS: ref #837911
2018-12-14 18:40:02 [DEBUG   ] summary = ERROR
2018-12-14 18:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837911  13 58466 67202345 A  ERRORERROR'
2018-12-14 18:40:02 [DEBUG   ] Got command RPT from MCS: ref #837913
2018-12-14 18:40:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837913  77 58466 67202537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:40:02 [DEBUG   ] Got command RPT from MCS: ref #837914
2018-12-14 18:40:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837914  12 58466 67202741 A  ERRORB•™š'
2018-12-14 18:40:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 18:40:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 18:40:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:40:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:40:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:40:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:40:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:40:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:40:38 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-12-14 18:40:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:40:54 [DEBUG   ] Got command RPT from MCS: ref #837919
2018-12-14 18:40:54 [DEBUG   ] summary = ERROR
2018-12-14 18:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837919  13 58466 67254665 A  ERRORERROR'
2018-12-14 18:40:54 [DEBUG   ] Got command RPT from MCS: ref #837920
2018-12-14 18:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837920  77 58466 67254666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:41:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 18:41:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:41:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:41:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:41:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:41:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:41:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:41:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:41:38 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-14 18:41:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 18:42:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:42:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 18:42:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:42:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:42:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:42:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:42:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:42:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:42:38 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-12-14 18:42:45 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-12-14 18:43:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 18:43:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 18:43:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:43:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:43:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:43:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:43:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:43:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:43:38 [DEBUG   ] Finished updating board flags in 1.545 seconds
2018-12-14 18:43:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 18:44:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 18:44:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 18:44:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:44:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:44:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:44:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:44:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:44:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:44:38 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-12-14 18:44:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 18:45:02 [DEBUG   ] Got command RPT from MCS: ref #837944
2018-12-14 18:45:02 [DEBUG   ] summary = ERROR
2018-12-14 18:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837944  13 58466 67502017 A  ERRORERROR'
2018-12-14 18:45:02 [DEBUG   ] Got command RPT from MCS: ref #837945
2018-12-14 18:45:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837945  77 58466 67502221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:45:02 [DEBUG   ] Got command RPT from MCS: ref #837946
2018-12-14 18:45:02 [DEBUG   ] summary = ERROR
2018-12-14 18:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837946  13 58466 67502425 A  ERRORERROR'
2018-12-14 18:45:02 [DEBUG   ] Got command RPT from MCS: ref #837947
2018-12-14 18:45:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837947  77 58466 67502629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:45:02 [DEBUG   ] Got command RPT from MCS: ref #837948
2018-12-14 18:45:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837948  12 58466 67502821 A  ERRORB”™š'
2018-12-14 18:45:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 18:45:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 18:45:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:45:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:45:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:45:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:45:38 [WARNING ] (13, 1, 'bot')
2018-12-14 18:45:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:45:38 [DEBUG   ] Finished updating board flags in 1.543 seconds
2018-12-14 18:45:45 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-14 18:45:54 [DEBUG   ] Got command RPT from MCS: ref #837949
2018-12-14 18:45:54 [DEBUG   ] summary = ERROR
2018-12-14 18:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837949  13 58466 67554669 A  ERRORERROR'
2018-12-14 18:45:54 [DEBUG   ] Got command RPT from MCS: ref #837950
2018-12-14 18:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837950  77 58466 67554670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:46:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 18:46:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 18:46:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:46:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:46:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:46:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:46:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:46:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:46:39 [DEBUG   ] Finished updating board flags in 2.203 seconds
2018-12-14 18:46:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:47:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:47:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:47:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:47:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:47:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:47:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:47:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:47:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:47:39 [DEBUG   ] Finished updating board flags in 2.124 seconds
2018-12-14 18:47:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 18:48:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:48:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:48:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 18:48:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:48:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:48:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:48:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:48:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:48:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:48:39 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-12-14 18:48:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 18:49:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:49:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:49:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:49:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:49:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:49:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:49:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:49:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:49:39 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-12-14 18:49:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:50:02 [DEBUG   ] Got command RPT from MCS: ref #837972
2018-12-14 18:50:02 [DEBUG   ] summary = ERROR
2018-12-14 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837972  13 58466 67802113 A  ERRORERROR'
2018-12-14 18:50:02 [DEBUG   ] Got command RPT from MCS: ref #837973
2018-12-14 18:50:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837973  77 58466 67802305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:50:02 [DEBUG   ] Got command RPT from MCS: ref #837974
2018-12-14 18:50:02 [DEBUG   ] summary = ERROR
2018-12-14 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837974  13 58466 67802509 A  ERRORERROR'
2018-12-14 18:50:02 [DEBUG   ] Got command RPT from MCS: ref #837976
2018-12-14 18:50:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837976  77 58466 67802701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:50:02 [DEBUG   ] Got command RPT from MCS: ref #837977
2018-12-14 18:50:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837977  12 58466 67802905 A  ERRORB–™š'
2018-12-14 18:50:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 18:50:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 18:50:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 18:50:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:50:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:50:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:50:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:50:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:50:39 [DEBUG   ] Finished updating board flags in 1.967 seconds
2018-12-14 18:50:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:50:54 [DEBUG   ] Got command RPT from MCS: ref #837986
2018-12-14 18:50:54 [DEBUG   ] summary = ERROR
2018-12-14 18:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837986  13 58466 67854677 A  ERRORERROR'
2018-12-14 18:50:54 [DEBUG   ] Got command RPT from MCS: ref #837987
2018-12-14 18:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   837987  77 58466 67854678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:51:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:51:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:51:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:51:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:51:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:51:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:51:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:51:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:51:39 [DEBUG   ] Finished updating board flags in 1.856 seconds
2018-12-14 18:51:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 18:52:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:52:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:52:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:52:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:52:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:52:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:52:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:52:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:52:39 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-12-14 18:52:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:53:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:53:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:53:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 18:53:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:53:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:53:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:53:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:53:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:53:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:53:39 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-14 18:53:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:54:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:54:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 18:54:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 18:54:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:54:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:54:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:54:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:54:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:54:39 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-12-14 18:54:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:55:02 [DEBUG   ] Got command RPT from MCS: ref #838007
2018-12-14 18:55:02 [DEBUG   ] summary = ERROR
2018-12-14 18:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838007  13 58466 68102189 A  ERRORERROR'
2018-12-14 18:55:02 [DEBUG   ] Got command RPT from MCS: ref #838008
2018-12-14 18:55:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838008  77 58466 68102381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:55:02 [DEBUG   ] Got command RPT from MCS: ref #838009
2018-12-14 18:55:02 [DEBUG   ] summary = ERROR
2018-12-14 18:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838009  13 58466 68102585 A  ERRORERROR'
2018-12-14 18:55:02 [DEBUG   ] Got command RPT from MCS: ref #838010
2018-12-14 18:55:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838010  77 58466 68102789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:55:02 [DEBUG   ] Got command RPT from MCS: ref #838011
2018-12-14 18:55:02 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 18:55:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838011  12 58466 68102981 A  ERRORB–™š'
2018-12-14 18:55:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:55:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:55:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:55:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 18:55:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:55:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:55:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:55:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:55:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:55:39 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-12-14 18:55:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:55:54 [DEBUG   ] Got command RPT from MCS: ref #838012
2018-12-14 18:55:54 [DEBUG   ] summary = ERROR
2018-12-14 18:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838012  13 58466 68154669 A  ERRORERROR'
2018-12-14 18:55:54 [DEBUG   ] Got command RPT from MCS: ref #838013
2018-12-14 18:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 18:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838013  77 58466 68154670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 18:56:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:56:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:56:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:56:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:56:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:56:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:56:39 [WARNING ] (13, 1, 'bot')
2018-12-14 18:56:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:56:39 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-12-14 18:56:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:57:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:57:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 18:57:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:57:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 18:57:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:57:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:57:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:57:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:57:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:57:40 [DEBUG   ] Finished updating board flags in 2.167 seconds
2018-12-14 18:57:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 18:58:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 18:58:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 18:58:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:58:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:58:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:58:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:58:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:58:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:58:40 [DEBUG   ] Finished updating board flags in 1.913 seconds
2018-12-14 18:58:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 18:59:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:59:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 18:59:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 18:59:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 18:59:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:59:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:59:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:59:40 [WARNING ] (13, 1, 'bot')
2018-12-14 18:59:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 18:59:40 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-12-14 18:59:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:00:02 [DEBUG   ] Got command RPT from MCS: ref #838039
2018-12-14 19:00:02 [DEBUG   ] summary = ERROR
2018-12-14 19:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838039  13 58466 68402269 A  ERRORERROR'
2018-12-14 19:00:02 [DEBUG   ] Got command RPT from MCS: ref #838040
2018-12-14 19:00:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838040  77 58466 68402461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:00:02 [DEBUG   ] Got command RPT from MCS: ref #838041
2018-12-14 19:00:02 [DEBUG   ] summary = ERROR
2018-12-14 19:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838041  13 58466 68402665 A  ERRORERROR'
2018-12-14 19:00:02 [DEBUG   ] Got command RPT from MCS: ref #838043
2018-12-14 19:00:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:00:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838043  77 58466 68402869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:00:03 [DEBUG   ] Got command RPT from MCS: ref #838045
2018-12-14 19:00:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838045  12 58466 68403061 A  ERRORB•™š'
2018-12-14 19:00:07 [DEBUG   ] Finished updating ant stats in 1.996 seconds
2018-12-14 19:00:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 19:00:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:00:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:00:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:00:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:00:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:00:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:00:40 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-12-14 19:00:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:00:54 [DEBUG   ] Got command RPT from MCS: ref #838049
2018-12-14 19:00:54 [DEBUG   ] summary = ERROR
2018-12-14 19:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838049  13 58466 68454677 A  ERRORERROR'
2018-12-14 19:00:54 [DEBUG   ] Got command RPT from MCS: ref #838050
2018-12-14 19:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838050  77 58466 68454678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:01:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 19:01:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:01:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:01:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:01:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:01:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:01:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:01:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:01:40 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-14 19:01:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:02:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:02:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:02:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:02:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:02:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:02:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:02:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:02:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:02:40 [DEBUG   ] Finished updating board flags in 1.869 seconds
2018-12-14 19:02:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:03:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:03:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:03:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:03:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:03:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:03:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:03:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:03:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:03:40 [DEBUG   ] Finished updating board flags in 1.682 seconds
2018-12-14 19:03:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 19:04:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:04:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 19:04:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:04:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:04:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:04:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:04:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:04:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:04:40 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-14 19:04:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:05:02 [DEBUG   ] Got command RPT from MCS: ref #838070
2018-12-14 19:05:02 [DEBUG   ] summary = ERROR
2018-12-14 19:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838070  13 58466 68702341 A  ERRORERROR'
2018-12-14 19:05:02 [DEBUG   ] Got command RPT from MCS: ref #838071
2018-12-14 19:05:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838071  77 58466 68702545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:05:02 [DEBUG   ] Got command RPT from MCS: ref #838072
2018-12-14 19:05:02 [DEBUG   ] summary = ERROR
2018-12-14 19:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838072  13 58466 68702749 A  ERRORERROR'
2018-12-14 19:05:02 [DEBUG   ] Got command RPT from MCS: ref #838073
2018-12-14 19:05:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:05:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838073  77 58466 68702941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:05:03 [DEBUG   ] Got command RPT from MCS: ref #838074
2018-12-14 19:05:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838074  12 58466 68703145 A  ERRORB”™š'
2018-12-14 19:05:06 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-14 19:05:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 19:05:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:05:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:05:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:05:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:05:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:05:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:05:40 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-14 19:05:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 19:05:54 [DEBUG   ] Got command RPT from MCS: ref #838079
2018-12-14 19:05:54 [DEBUG   ] summary = ERROR
2018-12-14 19:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838079  13 58466 68754677 A  ERRORERROR'
2018-12-14 19:05:54 [DEBUG   ] Got command RPT from MCS: ref #838080
2018-12-14 19:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838080  77 58466 68754678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:06:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 19:06:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 19:06:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:06:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:06:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:06:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:06:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:06:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:06:40 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-12-14 19:06:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 19:07:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 19:07:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:07:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:07:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:07:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:07:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:07:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:07:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:07:40 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-12-14 19:07:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 19:08:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 19:08:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 19:08:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:08:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 19:08:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:08:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:08:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:08:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:08:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:08:40 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-12-14 19:08:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 19:09:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 19:09:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:09:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:09:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:09:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:09:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:09:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:09:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:09:40 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-12-14 19:09:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 19:10:02 [DEBUG   ] Got command RPT from MCS: ref #838102
2018-12-14 19:10:02 [DEBUG   ] summary = ERROR
2018-12-14 19:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838102  13 58466 69002421 A  ERRORERROR'
2018-12-14 19:10:02 [DEBUG   ] Got command RPT from MCS: ref #838103
2018-12-14 19:10:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838103  77 58466 69002625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:10:02 [DEBUG   ] Got command RPT from MCS: ref #838104
2018-12-14 19:10:02 [DEBUG   ] summary = ERROR
2018-12-14 19:10:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838104  13 58466 69002817 A  ERRORERROR'
2018-12-14 19:10:03 [DEBUG   ] Got command RPT from MCS: ref #838106
2018-12-14 19:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838106  77 58466 69003021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:10:03 [DEBUG   ] Got command RPT from MCS: ref #838107
2018-12-14 19:10:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838107  12 58466 69003225 A  ERRORB–™š'
2018-12-14 19:10:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 19:10:28 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 19:10:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:10:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:10:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:10:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:10:40 [WARNING ] (13, 1, 'bot')
2018-12-14 19:10:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:10:40 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-12-14 19:10:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 19:10:54 [DEBUG   ] Got command RPT from MCS: ref #838112
2018-12-14 19:10:54 [DEBUG   ] summary = ERROR
2018-12-14 19:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838112  13 58466 69054673 A  ERRORERROR'
2018-12-14 19:10:54 [DEBUG   ] Got command RPT from MCS: ref #838113
2018-12-14 19:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838113  77 58466 69054674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:11:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:11:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 19:11:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-14 19:11:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:11:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:11:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:11:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:11:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:11:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:11:41 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-12-14 19:11:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 19:12:08 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2018-12-14 19:12:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:12:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:12:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 19:12:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:12:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:12:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:12:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:12:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:12:41 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-12-14 19:12:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:13:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 19:13:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:13:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:13:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:13:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:13:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:13:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:13:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:13:41 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-14 19:13:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:14:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 19:14:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 19:14:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 19:14:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:14:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:14:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:14:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:14:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:14:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:14:41 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-12-14 19:14:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 19:15:02 [DEBUG   ] Got command RPT from MCS: ref #838137
2018-12-14 19:15:02 [DEBUG   ] summary = ERROR
2018-12-14 19:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838137  13 58466 69302505 A  ERRORERROR'
2018-12-14 19:15:02 [DEBUG   ] Got command RPT from MCS: ref #838138
2018-12-14 19:15:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838138  77 58466 69302697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:15:02 [DEBUG   ] Got command RPT from MCS: ref #838139
2018-12-14 19:15:02 [DEBUG   ] summary = ERROR
2018-12-14 19:15:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838139  13 58466 69302901 A  ERRORERROR'
2018-12-14 19:15:03 [DEBUG   ] Got command RPT from MCS: ref #838140
2018-12-14 19:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838140  77 58466 69303105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:15:03 [DEBUG   ] Got command RPT from MCS: ref #838141
2018-12-14 19:15:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838141  12 58466 69303309 A  ERRORB—™š'
2018-12-14 19:15:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 19:15:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 19:15:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:15:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 19:15:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:15:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:15:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:15:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:15:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:15:41 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-12-14 19:15:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 19:15:54 [DEBUG   ] Got command RPT from MCS: ref #838142
2018-12-14 19:15:54 [DEBUG   ] summary = ERROR
2018-12-14 19:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838142  13 58466 69354681 A  ERRORERROR'
2018-12-14 19:15:54 [DEBUG   ] Got command RPT from MCS: ref #838143
2018-12-14 19:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838143  77 58466 69354682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:16:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 19:16:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 19:16:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:16:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 19:16:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:16:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:16:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:16:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:16:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:16:41 [DEBUG   ] Finished updating board flags in 1.517 seconds
2018-12-14 19:16:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 19:17:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 19:17:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 19:17:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:17:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:17:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:17:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:17:41 [WARNING ] (13, 1, 'bot')
2018-12-14 19:17:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:17:41 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-12-14 19:17:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 19:18:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 19:18:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 19:18:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:18:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:18:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:18:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:18:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:18:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:18:42 [DEBUG   ] Finished updating board flags in 2.242 seconds
2018-12-14 19:18:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 19:19:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:19:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 19:19:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:19:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 19:19:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:19:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:19:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:19:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:19:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:19:42 [DEBUG   ] Finished updating board flags in 2.214 seconds
2018-12-14 19:19:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 19:20:02 [DEBUG   ] Got command RPT from MCS: ref #838165
2018-12-14 19:20:02 [DEBUG   ] summary = ERROR
2018-12-14 19:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838165  13 58466 69602586 A  ERRORERROR'
2018-12-14 19:20:02 [DEBUG   ] Got command RPT from MCS: ref #838166
2018-12-14 19:20:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838166  77 58466 69602789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:20:02 [DEBUG   ] Got command RPT from MCS: ref #838167
2018-12-14 19:20:02 [DEBUG   ] summary = ERROR
2018-12-14 19:20:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838167  13 58466 69602981 A  ERRORERROR'
2018-12-14 19:20:03 [DEBUG   ] Got command RPT from MCS: ref #838169
2018-12-14 19:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838169  77 58466 69603185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:20:03 [DEBUG   ] Got command RPT from MCS: ref #838170
2018-12-14 19:20:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838170  12 58466 69603389 A  ERRORB–™š'
2018-12-14 19:20:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 19:20:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-14 19:20:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-12-14 19:20:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:20:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:20:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:20:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:20:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:20:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:20:42 [DEBUG   ] Finished updating board flags in 2.072 seconds
2018-12-14 19:20:49 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 19:20:54 [DEBUG   ] Got command RPT from MCS: ref #838179
2018-12-14 19:20:54 [DEBUG   ] summary = ERROR
2018-12-14 19:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838179  13 58466 69654685 A  ERRORERROR'
2018-12-14 19:20:54 [DEBUG   ] Got command RPT from MCS: ref #838180
2018-12-14 19:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838180  77 58466 69654686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:21:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 19:21:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:21:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:21:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 19:21:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:21:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:21:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:21:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:21:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:21:42 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-12-14 19:21:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:22:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 19:22:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 19:22:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:22:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:22:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:22:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:22:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:22:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:22:42 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-12-14 19:22:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 19:23:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:23:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 19:23:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:23:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:23:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:23:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:23:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:23:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:23:42 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-14 19:23:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 19:24:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:24:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:24:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:24:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:24:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:24:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:24:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:24:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:24:42 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-12-14 19:24:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 19:25:02 [DEBUG   ] Got command RPT from MCS: ref #838200
2018-12-14 19:25:02 [DEBUG   ] summary = ERROR
2018-12-14 19:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838200  13 58466 69902661 A  ERRORERROR'
2018-12-14 19:25:02 [DEBUG   ] Got command RPT from MCS: ref #838201
2018-12-14 19:25:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:25:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838201  77 58466 69902865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:25:03 [DEBUG   ] Got command RPT from MCS: ref #838202
2018-12-14 19:25:03 [DEBUG   ] summary = ERROR
2018-12-14 19:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838202  13 58466 69903069 A  ERRORERROR'
2018-12-14 19:25:03 [DEBUG   ] Got command RPT from MCS: ref #838203
2018-12-14 19:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838203  77 58466 69903261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:25:03 [DEBUG   ] Got command RPT from MCS: ref #838204
2018-12-14 19:25:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838204  12 58466 69903465 A  ERRORB•™š'
2018-12-14 19:25:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:25:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 19:25:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:25:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 19:25:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:25:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:25:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:25:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:25:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:25:42 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-12-14 19:25:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 19:25:54 [DEBUG   ] Got command RPT from MCS: ref #838205
2018-12-14 19:25:54 [DEBUG   ] summary = ERROR
2018-12-14 19:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838205  13 58466 69954685 A  ERRORERROR'
2018-12-14 19:25:54 [DEBUG   ] Got command RPT from MCS: ref #838206
2018-12-14 19:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838206  77 58466 69954686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:26:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 19:26:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 19:26:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:26:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:26:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:26:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:26:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:26:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:26:42 [DEBUG   ] Finished updating board flags in 1.696 seconds
2018-12-14 19:26:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 19:27:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:27:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 19:27:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:27:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:27:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:27:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:27:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:27:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:27:42 [DEBUG   ] Finished updating board flags in 1.494 seconds
2018-12-14 19:27:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 19:28:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 19:28:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 19:28:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:28:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 19:28:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:28:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:28:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:28:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:28:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:28:42 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-12-14 19:28:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 19:29:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 19:29:29 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2018-12-14 19:29:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:29:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:29:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:29:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:29:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:29:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:29:42 [DEBUG   ] Finished updating board flags in 1.499 seconds
2018-12-14 19:29:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:30:02 [DEBUG   ] Got command RPT from MCS: ref #838232
2018-12-14 19:30:02 [DEBUG   ] summary = ERROR
2018-12-14 19:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838232  13 58466 70202745 A  ERRORERROR'
2018-12-14 19:30:02 [DEBUG   ] Got command RPT from MCS: ref #838233
2018-12-14 19:30:02 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:30:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838233  77 58466 70202937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:30:03 [DEBUG   ] Got command RPT from MCS: ref #838234
2018-12-14 19:30:03 [DEBUG   ] summary = ERROR
2018-12-14 19:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838234  13 58466 70203141 A  ERRORERROR'
2018-12-14 19:30:03 [DEBUG   ] Got command RPT from MCS: ref #838236
2018-12-14 19:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838236  77 58466 70203345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:30:03 [DEBUG   ] Got command RPT from MCS: ref #838237
2018-12-14 19:30:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838237  12 58466 70203559 A  ERRORB”™š'
2018-12-14 19:30:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:30:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 19:30:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:30:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:30:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:30:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:30:42 [WARNING ] (13, 1, 'bot')
2018-12-14 19:30:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:30:42 [DEBUG   ] Finished updating board flags in 1.498 seconds
2018-12-14 19:30:49 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-14 19:30:54 [DEBUG   ] Got command RPT from MCS: ref #838242
2018-12-14 19:30:54 [DEBUG   ] summary = ERROR
2018-12-14 19:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838242  13 58466 70254685 A  ERRORERROR'
2018-12-14 19:30:54 [DEBUG   ] Got command RPT from MCS: ref #838243
2018-12-14 19:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838243  77 58466 70254686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:31:10 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 19:31:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 19:31:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:31:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:31:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:31:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:31:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:31:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:31:43 [DEBUG   ] Finished updating board flags in 2.134 seconds
2018-12-14 19:31:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:32:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 19:32:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 19:32:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:32:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:32:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:32:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:32:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:32:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:32:43 [DEBUG   ] Finished updating board flags in 1.969 seconds
2018-12-14 19:32:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:33:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:33:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 19:33:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:33:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 19:33:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:33:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:33:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:33:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:33:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:33:43 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-12-14 19:33:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 19:34:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 19:34:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:34:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:34:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-14 19:34:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:34:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:34:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:34:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:34:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:34:43 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-12-14 19:34:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 19:35:02 [DEBUG   ] Got command RPT from MCS: ref #838263
2018-12-14 19:35:02 [DEBUG   ] summary = ERROR
2018-12-14 19:35:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838263  13 58466 70502818 A  ERRORERROR'
2018-12-14 19:35:03 [DEBUG   ] Got command RPT from MCS: ref #838264
2018-12-14 19:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838264  77 58466 70503021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:35:03 [DEBUG   ] Got command RPT from MCS: ref #838265
2018-12-14 19:35:03 [DEBUG   ] summary = ERROR
2018-12-14 19:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838265  13 58466 70503226 A  ERRORERROR'
2018-12-14 19:35:03 [DEBUG   ] Got command RPT from MCS: ref #838266
2018-12-14 19:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838266  77 58466 70503429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:35:03 [DEBUG   ] Got command RPT from MCS: ref #838267
2018-12-14 19:35:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838267  12 58466 70503622 A  ERRORB•™š'
2018-12-14 19:35:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 19:35:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 19:35:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:35:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:35:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:35:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:35:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:35:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:35:43 [DEBUG   ] Finished updating board flags in 1.763 seconds
2018-12-14 19:35:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 19:35:54 [DEBUG   ] Got command RPT from MCS: ref #838272
2018-12-14 19:35:54 [DEBUG   ] summary = ERROR
2018-12-14 19:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838272  13 58466 70554681 A  ERRORERROR'
2018-12-14 19:35:54 [DEBUG   ] Got command RPT from MCS: ref #838273
2018-12-14 19:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838273  77 58466 70554682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:36:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 19:36:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 19:36:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:36:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:36:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:36:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:36:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:36:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:36:43 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-12-14 19:36:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 19:37:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:37:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:37:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 19:37:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:37:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 19:37:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:37:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:37:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:37:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:37:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:37:43 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-12-14 19:37:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:38:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 19:38:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 19:38:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:38:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:38:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:38:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:38:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:38:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:38:43 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-12-14 19:38:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 19:39:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:39:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:39:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:39:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:39:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:39:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:39:43 [WARNING ] (13, 1, 'bot')
2018-12-14 19:39:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:39:43 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-12-14 19:39:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 19:40:02 [DEBUG   ] Got command RPT from MCS: ref #838295
2018-12-14 19:40:02 [DEBUG   ] summary = ERROR
2018-12-14 19:40:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838295  13 58466 70802897 A  ERRORERROR'
2018-12-14 19:40:03 [DEBUG   ] Got command RPT from MCS: ref #838296
2018-12-14 19:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838296  77 58466 70803101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:40:03 [DEBUG   ] Got command RPT from MCS: ref #838297
2018-12-14 19:40:03 [DEBUG   ] summary = ERROR
2018-12-14 19:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838297  13 58466 70803305 A  ERRORERROR'
2018-12-14 19:40:03 [DEBUG   ] Got command RPT from MCS: ref #838298
2018-12-14 19:40:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838298  77 58466 70803497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:40:03 [DEBUG   ] Got command RPT from MCS: ref #838300
2018-12-14 19:40:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838300  12 58466 70803701 A  ERRORB—™š'
2018-12-14 19:40:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 19:40:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:40:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:40:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:40:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:40:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:40:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:40:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:40:44 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-12-14 19:40:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 19:40:54 [DEBUG   ] Got command RPT from MCS: ref #838305
2018-12-14 19:40:54 [DEBUG   ] summary = ERROR
2018-12-14 19:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838305  13 58466 70854681 A  ERRORERROR'
2018-12-14 19:40:54 [DEBUG   ] Got command RPT from MCS: ref #838306
2018-12-14 19:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838306  77 58466 70854682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:41:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:41:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:41:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:41:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:41:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:41:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:41:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:41:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:41:44 [DEBUG   ] Finished updating board flags in 2.148 seconds
2018-12-14 19:41:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 19:42:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 19:42:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 19:42:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:42:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 19:42:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:42:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:42:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:42:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:42:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:42:44 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-12-14 19:42:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 19:43:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 19:43:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:43:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:43:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:43:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:43:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:43:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:43:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:43:44 [DEBUG   ] Finished updating board flags in 1.964 seconds
2018-12-14 19:43:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 19:44:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:44:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 19:44:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:44:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:44:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:44:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:44:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:44:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:44:44 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-12-14 19:44:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 19:45:02 [DEBUG   ] Got command RPT from MCS: ref #838330
2018-12-14 19:45:02 [DEBUG   ] summary = ERROR
2018-12-14 19:45:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838330  13 58466 71102973 A  ERRORERROR'
2018-12-14 19:45:03 [DEBUG   ] Got command RPT from MCS: ref #838331
2018-12-14 19:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838331  77 58466 71103177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:45:03 [DEBUG   ] Got command RPT from MCS: ref #838332
2018-12-14 19:45:03 [DEBUG   ] summary = ERROR
2018-12-14 19:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838332  13 58466 71103381 A  ERRORERROR'
2018-12-14 19:45:03 [DEBUG   ] Got command RPT from MCS: ref #838333
2018-12-14 19:45:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838333  77 58466 71103574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:45:03 [DEBUG   ] Got command RPT from MCS: ref #838334
2018-12-14 19:45:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838334  12 58466 71103778 A  ERRORB–™š'
2018-12-14 19:45:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 19:45:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 19:45:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:45:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:45:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:45:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:45:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:45:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:45:44 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-12-14 19:45:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 19:45:54 [DEBUG   ] Got command RPT from MCS: ref #838335
2018-12-14 19:45:54 [DEBUG   ] summary = ERROR
2018-12-14 19:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838335  13 58466 71154681 A  ERRORERROR'
2018-12-14 19:45:54 [DEBUG   ] Got command RPT from MCS: ref #838336
2018-12-14 19:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838336  77 58466 71154682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:46:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:46:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 19:46:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:46:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:46:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:46:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:46:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:46:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:46:44 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-12-14 19:46:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:47:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:47:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 19:47:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:47:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:47:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:47:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:47:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:47:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:47:44 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-12-14 19:47:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 19:48:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:48:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 19:48:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:48:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:48:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:48:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:48:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:48:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:48:44 [DEBUG   ] Finished updating board flags in 1.670 seconds
2018-12-14 19:48:51 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 19:49:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 19:49:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 19:49:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:49:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:49:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:49:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:49:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:49:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:49:44 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-14 19:49:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 19:50:03 [DEBUG   ] Got command RPT from MCS: ref #838358
2018-12-14 19:50:03 [DEBUG   ] summary = ERROR
2018-12-14 19:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838358  13 58466 71403057 A  ERRORERROR'
2018-12-14 19:50:03 [DEBUG   ] Got command RPT from MCS: ref #838359
2018-12-14 19:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838359  77 58466 71403261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:50:03 [DEBUG   ] Got command RPT from MCS: ref #838360
2018-12-14 19:50:03 [DEBUG   ] summary = ERROR
2018-12-14 19:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838360  13 58466 71403453 A  ERRORERROR'
2018-12-14 19:50:03 [DEBUG   ] Got command RPT from MCS: ref #838362
2018-12-14 19:50:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838362  77 58466 71403657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:50:03 [DEBUG   ] Got command RPT from MCS: ref #838363
2018-12-14 19:50:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838363  12 58466 71403861 A  ERRORB•™š'
2018-12-14 19:50:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:50:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:50:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:50:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:50:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:50:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:50:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:50:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:50:44 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-12-14 19:50:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 19:50:54 [DEBUG   ] Got command RPT from MCS: ref #838372
2018-12-14 19:50:54 [DEBUG   ] summary = ERROR
2018-12-14 19:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838372  13 58466 71454689 A  ERRORERROR'
2018-12-14 19:50:54 [DEBUG   ] Got command RPT from MCS: ref #838373
2018-12-14 19:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838373  77 58466 71454690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:51:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 19:51:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 19:51:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:51:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:51:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:51:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:51:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:51:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:51:44 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-12-14 19:51:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 19:52:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 19:52:31 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-14 19:52:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:52:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:52:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:52:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:52:44 [WARNING ] (13, 1, 'bot')
2018-12-14 19:52:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:52:44 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-12-14 19:52:52 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-14 19:53:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 19:53:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:53:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:53:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:53:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:53:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:53:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:53:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:53:45 [DEBUG   ] Finished updating board flags in 2.243 seconds
2018-12-14 19:53:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:54:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 19:54:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 19:54:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:54:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:54:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:54:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:54:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:54:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:54:45 [DEBUG   ] Finished updating board flags in 2.159 seconds
2018-12-14 19:54:52 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 19:55:03 [DEBUG   ] Got command RPT from MCS: ref #838393
2018-12-14 19:55:03 [DEBUG   ] summary = ERROR
2018-12-14 19:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838393  13 58466 71703133 A  ERRORERROR'
2018-12-14 19:55:03 [DEBUG   ] Got command RPT from MCS: ref #838394
2018-12-14 19:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838394  77 58466 71703338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:55:03 [DEBUG   ] Got command RPT from MCS: ref #838395
2018-12-14 19:55:03 [DEBUG   ] summary = ERROR
2018-12-14 19:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838395  13 58466 71703554 A  ERRORERROR'
2018-12-14 19:55:03 [DEBUG   ] Got command RPT from MCS: ref #838396
2018-12-14 19:55:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838396  77 58466 71703733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:55:03 [DEBUG   ] Got command RPT from MCS: ref #838397
2018-12-14 19:55:03 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 19:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838397  12 58466 71703937 A  ERRORB”™š'
2018-12-14 19:55:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 19:55:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 19:55:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:55:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:55:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:55:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:55:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:55:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:55:45 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-12-14 19:55:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 19:55:54 [DEBUG   ] Got command RPT from MCS: ref #838398
2018-12-14 19:55:54 [DEBUG   ] summary = ERROR
2018-12-14 19:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838398  13 58466 71754689 A  ERRORERROR'
2018-12-14 19:55:54 [DEBUG   ] Got command RPT from MCS: ref #838399
2018-12-14 19:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 19:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838399  77 58466 71754690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 19:56:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 19:56:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 19:56:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:56:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:56:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:56:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:56:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:56:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:56:45 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-12-14 19:56:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 19:57:12 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 19:57:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 19:57:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:57:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:57:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:57:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:57:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:57:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:57:45 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-12-14 19:57:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 19:58:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 19:58:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 19:58:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:58:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:58:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:58:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:58:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:58:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:58:45 [DEBUG   ] Finished updating board flags in 1.927 seconds
2018-12-14 19:58:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 19:59:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 19:59:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 19:59:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 19:59:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 19:59:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:59:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:59:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:59:45 [WARNING ] (13, 1, 'bot')
2018-12-14 19:59:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 19:59:45 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-12-14 19:59:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:00:03 [DEBUG   ] Got command RPT from MCS: ref #838425
2018-12-14 20:00:03 [DEBUG   ] summary = ERROR
2018-12-14 20:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838425  13 58466 72003217 A  ERRORERROR'
2018-12-14 20:00:03 [DEBUG   ] Got command RPT from MCS: ref #838426
2018-12-14 20:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838426  77 58466 72003421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:00:03 [DEBUG   ] Got command RPT from MCS: ref #838427
2018-12-14 20:00:03 [DEBUG   ] summary = ERROR
2018-12-14 20:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838427  13 58466 72003617 A  ERRORERROR'
2018-12-14 20:00:03 [DEBUG   ] Got command RPT from MCS: ref #838429
2018-12-14 20:00:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838429  77 58466 72003821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:00:04 [DEBUG   ] Got command RPT from MCS: ref #838430
2018-12-14 20:00:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838430  12 58466 72004014 A  ERRORB”™š'
2018-12-14 20:00:12 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 20:00:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:00:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:00:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:00:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:00:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:00:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:00:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:00:45 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-14 20:00:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 20:00:54 [DEBUG   ] Got command RPT from MCS: ref #838435
2018-12-14 20:00:54 [DEBUG   ] summary = ERROR
2018-12-14 20:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838435  13 58466 72054689 A  ERRORERROR'
2018-12-14 20:00:54 [DEBUG   ] Got command RPT from MCS: ref #838436
2018-12-14 20:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838436  77 58466 72054690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:01:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:01:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:01:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:01:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 20:01:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:01:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:01:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:01:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:01:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:01:45 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-12-14 20:01:52 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-12-14 20:02:13 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 20:02:33 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 20:02:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:02:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:02:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:02:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:02:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:02:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:02:45 [DEBUG   ] Finished updating board flags in 1.749 seconds
2018-12-14 20:02:53 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 20:03:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 20:03:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 20:03:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:03:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:03:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:03:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:03:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:03:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:03:45 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-14 20:03:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 20:04:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 20:04:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 20:04:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:04:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 20:04:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:04:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:04:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:04:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:04:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:04:45 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-12-14 20:04:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 20:05:03 [DEBUG   ] Got command RPT from MCS: ref #838456
2018-12-14 20:05:03 [DEBUG   ] summary = ERROR
2018-12-14 20:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838456  13 58466 72303289 A  ERRORERROR'
2018-12-14 20:05:03 [DEBUG   ] Got command RPT from MCS: ref #838457
2018-12-14 20:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838457  77 58466 72303493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:05:03 [DEBUG   ] Got command RPT from MCS: ref #838458
2018-12-14 20:05:03 [DEBUG   ] summary = ERROR
2018-12-14 20:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838458  13 58466 72303698 A  ERRORERROR'
2018-12-14 20:05:03 [DEBUG   ] Got command RPT from MCS: ref #838459
2018-12-14 20:05:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838459  77 58466 72303902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:05:04 [DEBUG   ] Got command RPT from MCS: ref #838460
2018-12-14 20:05:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838460  12 58466 72304093 A  ERRORB–™š'
2018-12-14 20:05:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 20:05:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 20:05:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:05:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:05:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:05:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:05:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:05:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:05:45 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-14 20:05:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 20:05:54 [DEBUG   ] Got command RPT from MCS: ref #838465
2018-12-14 20:05:54 [DEBUG   ] summary = ERROR
2018-12-14 20:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838465  13 58466 72354685 A  ERRORERROR'
2018-12-14 20:05:54 [DEBUG   ] Got command RPT from MCS: ref #838466
2018-12-14 20:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838466  77 58466 72354686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:06:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 20:06:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 20:06:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:06:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:06:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:06:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:06:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:06:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:06:45 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-12-14 20:06:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 20:07:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 20:07:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 20:07:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:07:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 20:07:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:07:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:07:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:07:45 [WARNING ] (13, 1, 'bot')
2018-12-14 20:07:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:07:45 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-12-14 20:07:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 20:08:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 20:08:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 20:08:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:08:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:08:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:08:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:08:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:08:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:08:46 [DEBUG   ] Finished updating board flags in 2.122 seconds
2018-12-14 20:08:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 20:09:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 20:09:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 20:09:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 20:09:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:09:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:09:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:09:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:09:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:09:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:09:46 [DEBUG   ] Finished updating board flags in 1.930 seconds
2018-12-14 20:09:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 20:10:03 [DEBUG   ] Got command RPT from MCS: ref #838488
2018-12-14 20:10:03 [DEBUG   ] summary = ERROR
2018-12-14 20:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838488  13 58466 72603373 A  ERRORERROR'
2018-12-14 20:10:03 [DEBUG   ] Got command RPT from MCS: ref #838489
2018-12-14 20:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838489  77 58466 72603577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:10:03 [DEBUG   ] Got command RPT from MCS: ref #838490
2018-12-14 20:10:03 [DEBUG   ] summary = ERROR
2018-12-14 20:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838490  13 58466 72603781 A  ERRORERROR'
2018-12-14 20:10:03 [DEBUG   ] Got command RPT from MCS: ref #838492
2018-12-14 20:10:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838492  77 58466 72603973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:10:04 [DEBUG   ] Got command RPT from MCS: ref #838494
2018-12-14 20:10:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838494  12 58466 72604178 A  ERRORB—™š'
2018-12-14 20:10:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 20:10:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 20:10:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:10:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:10:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:10:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:10:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:10:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:10:46 [DEBUG   ] Finished updating board flags in 1.856 seconds
2018-12-14 20:10:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 20:10:54 [DEBUG   ] Got command RPT from MCS: ref #838498
2018-12-14 20:10:54 [DEBUG   ] summary = ERROR
2018-12-14 20:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838498  13 58466 72654689 A  ERRORERROR'
2018-12-14 20:10:54 [DEBUG   ] Got command RPT from MCS: ref #838499
2018-12-14 20:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838499  77 58466 72654690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:11:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 20:11:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 20:11:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:11:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:11:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:11:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:11:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:11:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:11:46 [DEBUG   ] Finished updating board flags in 1.738 seconds
2018-12-14 20:11:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 20:12:14 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-12-14 20:12:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 20:12:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 20:12:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:12:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:12:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:12:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:12:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:12:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:12:46 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-12-14 20:12:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:13:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 20:13:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:13:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:13:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 20:13:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:13:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:13:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:13:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:13:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:13:46 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-12-14 20:13:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:14:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:14:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 20:14:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:14:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:14:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:14:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:14:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:14:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:14:46 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-12-14 20:14:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 20:15:03 [DEBUG   ] Got command RPT from MCS: ref #838523
2018-12-14 20:15:03 [DEBUG   ] summary = ERROR
2018-12-14 20:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838523  13 58466 72903461 A  ERRORERROR'
2018-12-14 20:15:03 [DEBUG   ] Got command RPT from MCS: ref #838524
2018-12-14 20:15:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838524  77 58466 72903653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:15:03 [DEBUG   ] Got command RPT from MCS: ref #838525
2018-12-14 20:15:03 [DEBUG   ] summary = ERROR
2018-12-14 20:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838525  13 58466 72903857 A  ERRORERROR'
2018-12-14 20:15:04 [DEBUG   ] Got command RPT from MCS: ref #838526
2018-12-14 20:15:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838526  77 58466 72904061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:15:04 [DEBUG   ] Got command RPT from MCS: ref #838527
2018-12-14 20:15:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838527  12 58466 72904265 A  ERRORB–™š'
2018-12-14 20:15:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:15:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:15:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:15:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:15:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:15:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:15:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:15:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:15:46 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-12-14 20:15:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:15:54 [DEBUG   ] Got command RPT from MCS: ref #838528
2018-12-14 20:15:54 [DEBUG   ] summary = ERROR
2018-12-14 20:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838528  13 58466 72954689 A  ERRORERROR'
2018-12-14 20:15:54 [DEBUG   ] Got command RPT from MCS: ref #838529
2018-12-14 20:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838529  77 58466 72954690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:16:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 20:16:35 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-14 20:16:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:16:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 20:16:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:16:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:16:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:16:46 [WARNING ] (13, 1, 'bot')
2018-12-14 20:16:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:16:46 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-12-14 20:16:55 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 20:17:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 20:17:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 20:17:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:17:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:17:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:17:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:17:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:17:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:17:47 [DEBUG   ] Finished updating board flags in 2.045 seconds
2018-12-14 20:17:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 20:18:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 20:18:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 20:18:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:18:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:18:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:18:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:18:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:18:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:18:47 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-12-14 20:18:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:19:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:19:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:19:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:19:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:19:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:19:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:19:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:19:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:19:47 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-12-14 20:19:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 20:20:03 [DEBUG   ] Got command RPT from MCS: ref #838551
2018-12-14 20:20:03 [DEBUG   ] summary = ERROR
2018-12-14 20:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838551  13 58466 73203537 A  ERRORERROR'
2018-12-14 20:20:03 [DEBUG   ] Got command RPT from MCS: ref #838552
2018-12-14 20:20:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838552  77 58466 73203741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:20:03 [DEBUG   ] Got command RPT from MCS: ref #838553
2018-12-14 20:20:03 [DEBUG   ] summary = ERROR
2018-12-14 20:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838553  13 58466 73203933 A  ERRORERROR'
2018-12-14 20:20:04 [DEBUG   ] Got command RPT from MCS: ref #838555
2018-12-14 20:20:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838555  77 58466 73204137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:20:04 [DEBUG   ] Got command RPT from MCS: ref #838556
2018-12-14 20:20:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838556  12 58466 73204341 A  ERRORB•™š'
2018-12-14 20:20:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:20:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 20:20:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:20:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:20:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:20:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:20:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:20:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:20:47 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-12-14 20:20:54 [DEBUG   ] Got command RPT from MCS: ref #838565
2018-12-14 20:20:54 [DEBUG   ] summary = ERROR
2018-12-14 20:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838565  13 58466 73254697 A  ERRORERROR'
2018-12-14 20:20:54 [DEBUG   ] Got command RPT from MCS: ref #838566
2018-12-14 20:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838566  77 58466 73254698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:20:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 20:21:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 20:21:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 20:21:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:21:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:21:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:21:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:21:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:21:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:21:47 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-12-14 20:21:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 20:22:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 20:22:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 20:22:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:22:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:22:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:22:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:22:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:22:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:22:47 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-14 20:22:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 20:23:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 20:23:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 20:23:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:23:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:23:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:23:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:23:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:23:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:23:47 [DEBUG   ] Finished updating board flags in 1.694 seconds
2018-12-14 20:23:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 20:24:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 20:24:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 20:24:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:24:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:24:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:24:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:24:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:24:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:24:47 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-12-14 20:24:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 20:25:03 [DEBUG   ] Got command RPT from MCS: ref #838586
2018-12-14 20:25:03 [DEBUG   ] summary = ERROR
2018-12-14 20:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838586  13 58466 73503617 A  ERRORERROR'
2018-12-14 20:25:03 [DEBUG   ] Got command RPT from MCS: ref #838587
2018-12-14 20:25:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838587  77 58466 73503821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:25:04 [DEBUG   ] Got command RPT from MCS: ref #838588
2018-12-14 20:25:04 [DEBUG   ] summary = ERROR
2018-12-14 20:25:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838588  13 58466 73504014 A  ERRORERROR'
2018-12-14 20:25:04 [DEBUG   ] Got command RPT from MCS: ref #838589
2018-12-14 20:25:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:25:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838589  77 58466 73504217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:25:04 [DEBUG   ] Got command RPT from MCS: ref #838590
2018-12-14 20:25:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:25:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838590  12 58466 73504421 A  ERRORB•™š'
2018-12-14 20:25:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 20:25:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 20:25:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:25:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:25:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:25:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:25:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:25:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:25:47 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-12-14 20:25:54 [DEBUG   ] Got command RPT from MCS: ref #838591
2018-12-14 20:25:54 [DEBUG   ] summary = ERROR
2018-12-14 20:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838591  13 58466 73554697 A  ERRORERROR'
2018-12-14 20:25:54 [DEBUG   ] Got command RPT from MCS: ref #838592
2018-12-14 20:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838592  77 58466 73554698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:25:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 20:26:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 20:26:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:26:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:26:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:26:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:26:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:26:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:26:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:26:47 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-12-14 20:26:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:27:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:27:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:27:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:27:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 20:27:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:27:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:27:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:27:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:27:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:27:47 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-12-14 20:27:56 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 20:28:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 20:28:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 20:28:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:28:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:28:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:28:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:28:47 [WARNING ] (13, 1, 'bot')
2018-12-14 20:28:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:28:47 [DEBUG   ] Finished updating board flags in 1.487 seconds
2018-12-14 20:28:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 20:29:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:29:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 20:29:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:29:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:29:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:29:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:29:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:29:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:29:48 [DEBUG   ] Finished updating board flags in 2.171 seconds
2018-12-14 20:29:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 20:30:03 [DEBUG   ] Got command RPT from MCS: ref #838618
2018-12-14 20:30:03 [DEBUG   ] summary = ERROR
2018-12-14 20:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838618  13 58466 73803697 A  ERRORERROR'
2018-12-14 20:30:03 [DEBUG   ] Got command RPT from MCS: ref #838619
2018-12-14 20:30:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838619  77 58466 73803901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:30:04 [DEBUG   ] Got command RPT from MCS: ref #838620
2018-12-14 20:30:04 [DEBUG   ] summary = ERROR
2018-12-14 20:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838620  13 58466 73804093 A  ERRORERROR'
2018-12-14 20:30:04 [DEBUG   ] Got command RPT from MCS: ref #838622
2018-12-14 20:30:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838622  77 58466 73804297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:30:04 [DEBUG   ] Got command RPT from MCS: ref #838623
2018-12-14 20:30:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838623  12 58466 73804501 A  ERRORB”™š'
2018-12-14 20:30:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:30:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:30:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:30:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:30:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:30:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:30:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:30:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:30:48 [DEBUG   ] Finished updating board flags in 2.090 seconds
2018-12-14 20:30:54 [DEBUG   ] Got command RPT from MCS: ref #838628
2018-12-14 20:30:54 [DEBUG   ] summary = ERROR
2018-12-14 20:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838628  13 58466 73854693 A  ERRORERROR'
2018-12-14 20:30:54 [DEBUG   ] Got command RPT from MCS: ref #838629
2018-12-14 20:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838629  77 58466 73854694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:30:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:31:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 20:31:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 20:31:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:31:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:31:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:31:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:31:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:31:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:31:48 [DEBUG   ] Finished updating board flags in 1.924 seconds
2018-12-14 20:31:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:32:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:32:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 20:32:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:32:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:32:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:32:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:32:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:32:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:32:48 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-12-14 20:32:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:33:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:33:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:33:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:33:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:33:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:33:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:33:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:33:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:33:48 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-14 20:33:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 20:34:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 20:34:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 20:34:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:34:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:34:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:34:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:34:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:34:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:34:48 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-12-14 20:34:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 20:35:03 [DEBUG   ] Got command RPT from MCS: ref #838649
2018-12-14 20:35:03 [DEBUG   ] summary = ERROR
2018-12-14 20:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838649  13 58466 74103777 A  ERRORERROR'
2018-12-14 20:35:03 [DEBUG   ] Got command RPT from MCS: ref #838650
2018-12-14 20:35:03 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838650  77 58466 74103981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:35:04 [DEBUG   ] Got command RPT from MCS: ref #838651
2018-12-14 20:35:04 [DEBUG   ] summary = ERROR
2018-12-14 20:35:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838651  13 58466 74104185 A  ERRORERROR'
2018-12-14 20:35:04 [DEBUG   ] Got command RPT from MCS: ref #838652
2018-12-14 20:35:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:35:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838652  77 58466 74104377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:35:04 [DEBUG   ] Got command RPT from MCS: ref #838653
2018-12-14 20:35:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:35:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838653  12 58466 74104581 A  ERRORB”™š'
2018-12-14 20:35:17 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-12-14 20:35:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 20:35:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:35:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:35:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:35:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:35:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:35:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:35:48 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-14 20:35:54 [DEBUG   ] Got command RPT from MCS: ref #838658
2018-12-14 20:35:54 [DEBUG   ] summary = ERROR
2018-12-14 20:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838658  13 58466 74154697 A  ERRORERROR'
2018-12-14 20:35:54 [DEBUG   ] Got command RPT from MCS: ref #838659
2018-12-14 20:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838659  77 58466 74154698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:35:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 20:36:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:36:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 20:36:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:36:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:36:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:36:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:36:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:36:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:36:48 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-12-14 20:36:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:37:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 20:37:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 20:37:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:37:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:37:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:37:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:37:48 [WARNING ] (13, 1, 'bot')
2018-12-14 20:37:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:37:48 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-12-14 20:37:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 20:38:18 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-14 20:38:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 20:38:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:38:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:38:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:38:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:38:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:38:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:38:49 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-12-14 20:38:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 20:39:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 20:39:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:39:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:39:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:39:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:39:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:39:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:39:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:39:49 [DEBUG   ] Finished updating board flags in 2.047 seconds
2018-12-14 20:39:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:40:03 [DEBUG   ] Got command RPT from MCS: ref #838681
2018-12-14 20:40:03 [DEBUG   ] summary = ERROR
2018-12-14 20:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838681  13 58466 74403853 A  ERRORERROR'
2018-12-14 20:40:04 [DEBUG   ] Got command RPT from MCS: ref #838682
2018-12-14 20:40:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838682  77 58466 74404057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:40:04 [DEBUG   ] Got command RPT from MCS: ref #838683
2018-12-14 20:40:04 [DEBUG   ] summary = ERROR
2018-12-14 20:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838683  13 58466 74404261 A  ERRORERROR'
2018-12-14 20:40:04 [DEBUG   ] Got command RPT from MCS: ref #838685
2018-12-14 20:40:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838685  77 58466 74404453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:40:04 [DEBUG   ] Got command RPT from MCS: ref #838686
2018-12-14 20:40:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838686  12 58466 74404657 A  ERRORB•™š'
2018-12-14 20:40:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 20:40:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 20:40:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:40:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:40:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:40:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:40:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:40:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:40:49 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-12-14 20:40:54 [DEBUG   ] Got command RPT from MCS: ref #838691
2018-12-14 20:40:54 [DEBUG   ] summary = ERROR
2018-12-14 20:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838691  13 58466 74454697 A  ERRORERROR'
2018-12-14 20:40:54 [DEBUG   ] Got command RPT from MCS: ref #838692
2018-12-14 20:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838692  77 58466 74454698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:40:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 20:41:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 20:41:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 20:41:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:41:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:41:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:41:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:41:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:41:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:41:49 [DEBUG   ] Finished updating board flags in 1.839 seconds
2018-12-14 20:41:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 20:42:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 20:42:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 20:42:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 20:42:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:42:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:42:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:42:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:42:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:42:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:42:49 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-12-14 20:42:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 20:43:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 20:43:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 20:43:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-14 20:43:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:43:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:43:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:43:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:43:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:43:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:43:49 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-12-14 20:43:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:44:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 20:44:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 20:44:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:44:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:44:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:44:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:44:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:44:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:44:49 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-12-14 20:44:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 20:45:03 [DEBUG   ] Got command RPT from MCS: ref #838716
2018-12-14 20:45:03 [DEBUG   ] summary = ERROR
2018-12-14 20:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838716  13 58466 74703933 A  ERRORERROR'
2018-12-14 20:45:04 [DEBUG   ] Got command RPT from MCS: ref #838717
2018-12-14 20:45:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838717  77 58466 74704137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:45:04 [DEBUG   ] Got command RPT from MCS: ref #838718
2018-12-14 20:45:04 [DEBUG   ] summary = ERROR
2018-12-14 20:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838718  13 58466 74704341 A  ERRORERROR'
2018-12-14 20:45:04 [DEBUG   ] Got command RPT from MCS: ref #838719
2018-12-14 20:45:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838719  77 58466 74704533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:45:04 [DEBUG   ] Got command RPT from MCS: ref #838720
2018-12-14 20:45:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838720  12 58466 74704737 A  ERRORB—™š'
2018-12-14 20:45:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 20:45:40 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 20:45:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:45:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:45:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:45:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:45:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:45:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:45:49 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-12-14 20:45:54 [DEBUG   ] Got command RPT from MCS: ref #838721
2018-12-14 20:45:54 [DEBUG   ] summary = ERROR
2018-12-14 20:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838721  13 58466 74754701 A  ERRORERROR'
2018-12-14 20:45:54 [DEBUG   ] Got command RPT from MCS: ref #838722
2018-12-14 20:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838722  77 58466 74754702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:46:00 [DEBUG   ] Finished updating ant stats in 0.967 seconds
2018-12-14 20:46:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:46:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:46:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:46:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:46:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:46:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:46:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:46:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:46:49 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-12-14 20:47:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:47:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 20:47:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 20:47:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:47:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:47:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:47:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:47:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:47:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:47:49 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-12-14 20:48:00 [DEBUG   ] Finished updating ant stats in 0.419 seconds
2018-12-14 20:48:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 20:48:41 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 20:48:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:48:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:48:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:48:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:48:49 [WARNING ] (13, 1, 'bot')
2018-12-14 20:48:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:48:49 [DEBUG   ] Finished updating board flags in 1.351 seconds
2018-12-14 20:49:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 20:49:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 20:49:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 20:49:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:49:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:49:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:49:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:49:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:49:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:49:50 [DEBUG   ] Finished updating board flags in 2.110 seconds
2018-12-14 20:50:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 20:50:04 [DEBUG   ] Got command RPT from MCS: ref #838746
2018-12-14 20:50:04 [DEBUG   ] summary = ERROR
2018-12-14 20:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838746  13 58466 75004013 A  ERRORERROR'
2018-12-14 20:50:04 [DEBUG   ] Got command RPT from MCS: ref #838747
2018-12-14 20:50:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838747  77 58466 75004217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:50:04 [DEBUG   ] Got command RPT from MCS: ref #838748
2018-12-14 20:50:04 [DEBUG   ] summary = ERROR
2018-12-14 20:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838748  13 58466 75004421 A  ERRORERROR'
2018-12-14 20:50:04 [DEBUG   ] Got command RPT from MCS: ref #838750
2018-12-14 20:50:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838750  77 58466 75004613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:50:04 [DEBUG   ] Got command RPT from MCS: ref #838751
2018-12-14 20:50:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838751  12 58466 75004817 A  ERRORB–™š'
2018-12-14 20:50:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 20:50:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 20:50:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:50:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 20:50:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 20:50:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:50:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:50:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:50:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:50:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:50:50 [DEBUG   ] Finished updating board flags in 1.951 seconds
2018-12-14 20:50:54 [DEBUG   ] Got command RPT from MCS: ref #838763
2018-12-14 20:50:54 [DEBUG   ] summary = ERROR
2018-12-14 20:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838763  13 58466 75054701 A  ERRORERROR'
2018-12-14 20:50:54 [DEBUG   ] Got command RPT from MCS: ref #838764
2018-12-14 20:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838764  77 58466 75054702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:51:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 20:51:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:51:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:51:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:51:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:51:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:51:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:51:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:51:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:51:50 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-14 20:52:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:52:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 20:52:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 20:52:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:52:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:52:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:52:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:52:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:52:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:52:50 [DEBUG   ] Finished updating board flags in 1.839 seconds
2018-12-14 20:53:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 20:53:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 20:53:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 20:53:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:53:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:53:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:53:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:53:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:53:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:53:50 [DEBUG   ] Finished updating board flags in 1.760 seconds
2018-12-14 20:54:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 20:54:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 20:54:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 20:54:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:54:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:54:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:54:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:54:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:54:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:54:50 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-12-14 20:55:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 20:55:04 [DEBUG   ] Got command RPT from MCS: ref #838789
2018-12-14 20:55:04 [DEBUG   ] summary = ERROR
2018-12-14 20:55:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838789  13 58466 75304097 A  ERRORERROR'
2018-12-14 20:55:04 [DEBUG   ] Got command RPT from MCS: ref #838790
2018-12-14 20:55:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:55:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838790  77 58466 75304301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:55:04 [DEBUG   ] Got command RPT from MCS: ref #838791
2018-12-14 20:55:04 [DEBUG   ] summary = ERROR
2018-12-14 20:55:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838791  13 58466 75304493 A  ERRORERROR'
2018-12-14 20:55:04 [DEBUG   ] Got command RPT from MCS: ref #838792
2018-12-14 20:55:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:55:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838792  77 58466 75304697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:55:04 [DEBUG   ] Got command RPT from MCS: ref #838793
2018-12-14 20:55:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 20:55:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838793  12 58466 75304901 A  ERRORB•™š'
2018-12-14 20:55:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 20:55:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 20:55:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:55:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:55:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:55:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:55:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:55:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:55:50 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-12-14 20:55:54 [DEBUG   ] Got command RPT from MCS: ref #838794
2018-12-14 20:55:54 [DEBUG   ] summary = ERROR
2018-12-14 20:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838794  13 58466 75354747 A  ERRORERROR'
2018-12-14 20:55:54 [DEBUG   ] Got command RPT from MCS: ref #838795
2018-12-14 20:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 20:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838795  77 58466 75354747 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 20:56:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 20:56:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 20:56:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:56:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:56:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:56:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:56:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:56:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:56:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:56:50 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-14 20:57:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 20:57:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 20:57:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 20:57:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:57:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:57:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:57:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:57:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:57:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:57:50 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-12-14 20:58:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 20:58:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 20:58:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 20:58:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:58:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 20:58:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:58:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:58:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:58:50 [WARNING ] (13, 1, 'bot')
2018-12-14 20:58:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:58:50 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-12-14 20:59:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 20:59:23 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 20:59:43 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 20:59:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 20:59:51 [WARNING ] (13, 1, 'bot')
2018-12-14 20:59:51 [WARNING ] (13, 1, 'bot')
2018-12-14 20:59:51 [WARNING ] (13, 1, 'bot')
2018-12-14 20:59:51 [WARNING ] (13, 1, 'bot')
2018-12-14 20:59:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 20:59:51 [DEBUG   ] Finished updating board flags in 2.235 seconds
2018-12-14 21:00:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 21:00:04 [DEBUG   ] Got command RPT from MCS: ref #838821
2018-12-14 21:00:04 [DEBUG   ] summary = ERROR
2018-12-14 21:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838821  13 58466 75604169 A  ERRORERROR'
2018-12-14 21:00:04 [DEBUG   ] Got command RPT from MCS: ref #838822
2018-12-14 21:00:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838822  77 58466 75604373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:00:04 [DEBUG   ] Got command RPT from MCS: ref #838823
2018-12-14 21:00:04 [DEBUG   ] summary = ERROR
2018-12-14 21:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838823  13 58466 75604577 A  ERRORERROR'
2018-12-14 21:00:04 [DEBUG   ] Got command RPT from MCS: ref #838825
2018-12-14 21:00:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838825  77 58466 75604781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:00:04 [DEBUG   ] Got command RPT from MCS: ref #838826
2018-12-14 21:00:04 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838826  12 58466 75604973 A  ERRORB•™š'
2018-12-14 21:00:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 21:00:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 21:00:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:00:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:00:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:00:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:00:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:00:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:00:51 [DEBUG   ] Finished updating board flags in 2.126 seconds
2018-12-14 21:00:54 [DEBUG   ] Got command RPT from MCS: ref #838831
2018-12-14 21:00:54 [DEBUG   ] summary = ERROR
2018-12-14 21:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838831  13 58466 75654705 A  ERRORERROR'
2018-12-14 21:00:54 [DEBUG   ] Got command RPT from MCS: ref #838832
2018-12-14 21:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838832  77 58466 75654706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:01:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 21:01:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 21:01:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 21:01:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:01:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:01:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:01:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:01:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:01:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:01:51 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-12-14 21:02:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 21:02:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 21:02:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 21:02:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:02:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:02:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:02:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:02:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:02:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:02:51 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-12-14 21:03:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 21:03:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 21:03:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:03:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:03:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:03:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:03:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:03:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:03:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:03:51 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-12-14 21:04:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:04:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 21:04:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 21:04:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:04:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:04:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:04:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:04:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:04:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:04:51 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-14 21:05:04 [DEBUG   ] Got command RPT from MCS: ref #838852
2018-12-14 21:05:04 [DEBUG   ] summary = ERROR
2018-12-14 21:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838852  13 58466 75904249 A  ERRORERROR'
2018-12-14 21:05:04 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-14 21:05:04 [DEBUG   ] Got command RPT from MCS: ref #838853
2018-12-14 21:05:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838853  77 58466 75904453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:05:04 [DEBUG   ] Got command RPT from MCS: ref #838854
2018-12-14 21:05:04 [DEBUG   ] summary = ERROR
2018-12-14 21:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838854  13 58466 75904661 A  ERRORERROR'
2018-12-14 21:05:04 [DEBUG   ] Got command RPT from MCS: ref #838855
2018-12-14 21:05:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:05:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838855  77 58466 75904853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:05:05 [DEBUG   ] Got command RPT from MCS: ref #838856
2018-12-14 21:05:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838856  12 58466 75905057 A  ERRORB”™š'
2018-12-14 21:05:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 21:05:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 21:05:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:05:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 21:05:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:05:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:05:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:05:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:05:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:05:51 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-12-14 21:05:54 [DEBUG   ] Got command RPT from MCS: ref #838861
2018-12-14 21:05:54 [DEBUG   ] summary = ERROR
2018-12-14 21:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838861  13 58466 75954697 A  ERRORERROR'
2018-12-14 21:05:54 [DEBUG   ] Got command RPT from MCS: ref #838862
2018-12-14 21:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838862  77 58466 75954698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:06:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 21:06:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 21:06:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 21:06:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 21:06:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:06:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 21:06:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:06:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:06:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:06:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:06:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:06:51 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-12-14 21:07:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 21:07:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 21:07:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 21:07:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-14 21:07:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:07:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:07:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:07:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:07:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:07:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:07:51 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-14 21:08:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 21:08:24 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-12-14 21:08:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:08:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:08:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:08:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:08:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:08:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:08:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:08:51 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-12-14 21:09:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 21:09:24 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 21:09:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 21:09:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:09:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:09:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:09:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:09:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:09:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:09:51 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-14 21:10:04 [DEBUG   ] Got command RPT from MCS: ref #838884
2018-12-14 21:10:04 [DEBUG   ] summary = ERROR
2018-12-14 21:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838884  13 58466 76204330 A  ERRORERROR'
2018-12-14 21:10:04 [DEBUG   ] Got command RPT from MCS: ref #838885
2018-12-14 21:10:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838885  77 58466 76204533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:10:04 [DEBUG   ] Got command RPT from MCS: ref #838886
2018-12-14 21:10:04 [DEBUG   ] summary = ERROR
2018-12-14 21:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838886  13 58466 76204737 A  ERRORERROR'
2018-12-14 21:10:04 [DEBUG   ] Got command RPT from MCS: ref #838888
2018-12-14 21:10:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:10:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838888  77 58466 76204929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:10:05 [DEBUG   ] Got command RPT from MCS: ref #838889
2018-12-14 21:10:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838889  12 58466 76205133 A  ERRORB—™š'
2018-12-14 21:10:05 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-14 21:10:25 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-14 21:10:44 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-12-14 21:10:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:10:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:10:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:10:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:10:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:10:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:10:51 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-12-14 21:10:54 [DEBUG   ] Got command RPT from MCS: ref #838894
2018-12-14 21:10:54 [DEBUG   ] summary = ERROR
2018-12-14 21:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838894  13 58466 76254705 A  ERRORERROR'
2018-12-14 21:10:54 [DEBUG   ] Got command RPT from MCS: ref #838895
2018-12-14 21:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838895  77 58466 76254706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:11:04 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-12-14 21:11:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 21:11:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 21:11:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:11:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:11:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:11:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:11:51 [WARNING ] (13, 1, 'bot')
2018-12-14 21:11:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:11:51 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-12-14 21:12:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 21:12:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 21:12:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 21:12:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:12:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:12:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:12:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:12:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:12:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:12:52 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-12-14 21:13:05 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 21:13:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 21:13:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 21:13:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:13:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:13:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:13:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:13:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:13:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:13:52 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-12-14 21:14:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 21:14:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 21:14:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 21:14:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:14:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 21:14:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:14:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:14:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:14:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:14:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:14:52 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-12-14 21:15:04 [DEBUG   ] Got command RPT from MCS: ref #838919
2018-12-14 21:15:04 [DEBUG   ] summary = ERROR
2018-12-14 21:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838919  13 58466 76504409 A  ERRORERROR'
2018-12-14 21:15:04 [DEBUG   ] Got command RPT from MCS: ref #838920
2018-12-14 21:15:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838920  77 58466 76504613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:15:04 [DEBUG   ] Got command RPT from MCS: ref #838921
2018-12-14 21:15:04 [DEBUG   ] summary = ERROR
2018-12-14 21:15:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838921  13 58466 76504817 A  ERRORERROR'
2018-12-14 21:15:05 [DEBUG   ] Got command RPT from MCS: ref #838922
2018-12-14 21:15:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838922  77 58466 76505021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:15:05 [DEBUG   ] Got command RPT from MCS: ref #838923
2018-12-14 21:15:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838923  12 58466 76505213 A  ERRORB—™š'
2018-12-14 21:15:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 21:15:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 21:15:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 21:15:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:15:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:15:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:15:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:15:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:15:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:15:52 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-12-14 21:15:54 [DEBUG   ] Got command RPT from MCS: ref #838924
2018-12-14 21:15:54 [DEBUG   ] summary = ERROR
2018-12-14 21:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838924  13 58466 76554701 A  ERRORERROR'
2018-12-14 21:15:54 [DEBUG   ] Got command RPT from MCS: ref #838925
2018-12-14 21:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838925  77 58466 76554702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:16:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 21:16:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 21:16:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 21:16:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:16:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:16:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:16:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:16:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:16:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:16:52 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-14 21:17:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 21:17:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 21:17:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 21:17:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:17:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:17:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:17:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:17:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:17:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:17:52 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-14 21:18:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 21:18:26 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-12-14 21:18:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 21:18:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:18:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:18:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:18:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:18:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:18:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:18:52 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-12-14 21:19:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 21:19:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 21:19:46 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-14 21:19:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:19:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:19:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:19:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:19:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:19:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:19:52 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-12-14 21:20:04 [DEBUG   ] Got command RPT from MCS: ref #838947
2018-12-14 21:20:04 [DEBUG   ] summary = ERROR
2018-12-14 21:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838947  13 58466 76804493 A  ERRORERROR'
2018-12-14 21:20:04 [DEBUG   ] Got command RPT from MCS: ref #838948
2018-12-14 21:20:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838948  77 58466 76804697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:20:04 [DEBUG   ] Got command RPT from MCS: ref #838949
2018-12-14 21:20:04 [DEBUG   ] summary = ERROR
2018-12-14 21:20:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838949  13 58466 76804901 A  ERRORERROR'
2018-12-14 21:20:05 [DEBUG   ] Got command RPT from MCS: ref #838951
2018-12-14 21:20:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838951  77 58466 76805093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:20:05 [DEBUG   ] Got command RPT from MCS: ref #838952
2018-12-14 21:20:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838952  12 58466 76805298 A  ERRORB–™š'
2018-12-14 21:20:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 21:20:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 21:20:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 21:20:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:20:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 21:20:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:20:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:20:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:20:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:20:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:20:52 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-12-14 21:20:54 [DEBUG   ] Got command RPT from MCS: ref #838961
2018-12-14 21:20:54 [DEBUG   ] summary = ERROR
2018-12-14 21:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838961  13 58466 76854709 A  ERRORERROR'
2018-12-14 21:20:54 [DEBUG   ] Got command RPT from MCS: ref #838962
2018-12-14 21:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838962  77 58466 76854710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:21:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 21:21:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 21:21:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 21:21:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:21:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:21:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:21:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:21:52 [WARNING ] (13, 1, 'bot')
2018-12-14 21:21:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:21:52 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-12-14 21:22:07 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-12-14 21:22:27 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-12-14 21:22:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 21:22:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:22:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 21:22:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:22:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:22:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:22:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:22:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:22:53 [DEBUG   ] Finished updating board flags in 2.250 seconds
2018-12-14 21:23:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 21:23:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 21:23:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 21:23:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:23:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:23:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:23:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:23:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:23:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:23:53 [DEBUG   ] Finished updating board flags in 2.108 seconds
2018-12-14 21:24:07 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 21:24:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 21:24:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 21:24:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:24:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:24:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:24:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:24:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:24:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:24:53 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-12-14 21:25:04 [DEBUG   ] Got command RPT from MCS: ref #838982
2018-12-14 21:25:04 [DEBUG   ] summary = ERROR
2018-12-14 21:25:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838982  13 58466 77104577 A  ERRORERROR'
2018-12-14 21:25:04 [DEBUG   ] Got command RPT from MCS: ref #838983
2018-12-14 21:25:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:25:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838983  77 58466 77104769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:25:04 [DEBUG   ] Got command RPT from MCS: ref #838984
2018-12-14 21:25:04 [DEBUG   ] summary = ERROR
2018-12-14 21:25:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838984  13 58466 77104973 A  ERRORERROR'
2018-12-14 21:25:05 [DEBUG   ] Got command RPT from MCS: ref #838985
2018-12-14 21:25:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838985  77 58466 77105177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:25:05 [DEBUG   ] Got command RPT from MCS: ref #838986
2018-12-14 21:25:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838986  12 58466 77105381 A  ERRORB•™š'
2018-12-14 21:25:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 21:25:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 21:25:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 21:25:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:25:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:25:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:25:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:25:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:25:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:25:53 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-12-14 21:25:54 [DEBUG   ] Got command RPT from MCS: ref #838987
2018-12-14 21:25:54 [DEBUG   ] summary = ERROR
2018-12-14 21:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838987  13 58466 77154713 A  ERRORERROR'
2018-12-14 21:25:54 [DEBUG   ] Got command RPT from MCS: ref #838988
2018-12-14 21:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   838988  77 58466 77154714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:26:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:26:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:26:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 21:26:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-12-14 21:26:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:26:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:26:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:26:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:26:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:26:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:26:53 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-14 21:27:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 21:27:28 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 21:27:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 21:27:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 21:27:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:27:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:27:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:27:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:27:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:27:53 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-14 21:28:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 21:28:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 21:28:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 21:28:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:28:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:28:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:28:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:28:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:28:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:28:53 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-14 21:29:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 21:29:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 21:29:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:29:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:29:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 21:29:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:29:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:29:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:29:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:29:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:29:53 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-12-14 21:30:04 [DEBUG   ] Got command RPT from MCS: ref #839014
2018-12-14 21:30:04 [DEBUG   ] summary = ERROR
2018-12-14 21:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839014  13 58466 77404649 A  ERRORERROR'
2018-12-14 21:30:04 [DEBUG   ] Got command RPT from MCS: ref #839015
2018-12-14 21:30:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839015  77 58466 77404853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:30:05 [DEBUG   ] Got command RPT from MCS: ref #839016
2018-12-14 21:30:05 [DEBUG   ] summary = ERROR
2018-12-14 21:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839016  13 58466 77405057 A  ERRORERROR'
2018-12-14 21:30:05 [DEBUG   ] Got command RPT from MCS: ref #839018
2018-12-14 21:30:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839018  77 58466 77405261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:30:05 [DEBUG   ] Got command RPT from MCS: ref #839019
2018-12-14 21:30:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839019  12 58466 77405453 A  ERRORB•™š'
2018-12-14 21:30:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 21:30:29 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-14 21:30:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 21:30:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:30:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:30:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:30:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:30:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:30:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:30:53 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-12-14 21:30:54 [DEBUG   ] Got command RPT from MCS: ref #839024
2018-12-14 21:30:54 [DEBUG   ] summary = ERROR
2018-12-14 21:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839024  13 58466 77454709 A  ERRORERROR'
2018-12-14 21:30:54 [DEBUG   ] Got command RPT from MCS: ref #839025
2018-12-14 21:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839025  77 58466 77454710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:31:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 21:31:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 21:31:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 21:31:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:31:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:31:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:31:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:31:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:31:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:31:53 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-14 21:32:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 21:32:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 21:32:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 21:32:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:32:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 21:32:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:32:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:32:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:32:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:32:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:32:53 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-12-14 21:33:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 21:33:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 21:33:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 21:33:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:33:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 21:33:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:33:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:33:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:33:53 [WARNING ] (13, 1, 'bot')
2018-12-14 21:33:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:33:53 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-12-14 21:34:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 21:34:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 21:34:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:34:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:34:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:34:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:34:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:34:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:34:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:34:54 [DEBUG   ] Finished updating board flags in 2.051 seconds
2018-12-14 21:35:04 [DEBUG   ] Got command RPT from MCS: ref #839045
2018-12-14 21:35:04 [DEBUG   ] summary = ERROR
2018-12-14 21:35:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839045  13 58466 77704737 A  ERRORERROR'
2018-12-14 21:35:04 [DEBUG   ] Got command RPT from MCS: ref #839046
2018-12-14 21:35:04 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:35:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839046  77 58466 77704941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:35:05 [DEBUG   ] Got command RPT from MCS: ref #839047
2018-12-14 21:35:05 [DEBUG   ] summary = ERROR
2018-12-14 21:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839047  13 58466 77705133 A  ERRORERROR'
2018-12-14 21:35:05 [DEBUG   ] Got command RPT from MCS: ref #839048
2018-12-14 21:35:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839048  77 58466 77705337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:35:05 [DEBUG   ] Got command RPT from MCS: ref #839049
2018-12-14 21:35:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839049  12 58466 77705541 A  ERRORB”™š'
2018-12-14 21:35:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:35:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 21:35:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 21:35:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:35:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:35:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:35:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:35:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:35:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:35:54 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-12-14 21:35:54 [DEBUG   ] Got command RPT from MCS: ref #839054
2018-12-14 21:35:54 [DEBUG   ] summary = ERROR
2018-12-14 21:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839054  13 58466 77754705 A  ERRORERROR'
2018-12-14 21:35:54 [DEBUG   ] Got command RPT from MCS: ref #839055
2018-12-14 21:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839055  77 58466 77754706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:36:10 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-14 21:36:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 21:36:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 21:36:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:36:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:36:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:36:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:36:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:36:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:36:54 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-14 21:37:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 21:37:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 21:37:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 21:37:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:37:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 21:37:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:37:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:37:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:37:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:37:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:37:54 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-12-14 21:38:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 21:38:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 21:38:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 21:38:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-12-14 21:38:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:38:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:38:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:38:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:38:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:38:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:38:54 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-14 21:39:10 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-14 21:39:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 21:39:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:39:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:39:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:39:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:39:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:39:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:39:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:39:54 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-12-14 21:40:04 [DEBUG   ] Got command RPT from MCS: ref #839077
2018-12-14 21:40:04 [DEBUG   ] summary = ERROR
2018-12-14 21:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839077  13 58466 78004829 A  ERRORERROR'
2018-12-14 21:40:05 [DEBUG   ] Got command RPT from MCS: ref #839078
2018-12-14 21:40:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839078  77 58466 78005033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:40:05 [DEBUG   ] Got command RPT from MCS: ref #839079
2018-12-14 21:40:05 [DEBUG   ] summary = ERROR
2018-12-14 21:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839079  13 58466 78005237 A  ERRORERROR'
2018-12-14 21:40:05 [DEBUG   ] Got command RPT from MCS: ref #839081
2018-12-14 21:40:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839081  77 58466 78005441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:40:05 [DEBUG   ] Got command RPT from MCS: ref #839082
2018-12-14 21:40:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839082  12 58466 78005633 A  ERRORB”™š'
2018-12-14 21:40:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 21:40:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 21:40:51 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 21:40:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:40:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 21:40:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:40:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:40:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:40:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:40:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:40:54 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-14 21:40:54 [DEBUG   ] Got command RPT from MCS: ref #839087
2018-12-14 21:40:54 [DEBUG   ] summary = ERROR
2018-12-14 21:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839087  13 58466 78054705 A  ERRORERROR'
2018-12-14 21:40:54 [DEBUG   ] Got command RPT from MCS: ref #839088
2018-12-14 21:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839088  77 58466 78054706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:41:11 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 21:41:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 21:41:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 21:41:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:41:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:41:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:41:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:41:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:41:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:41:54 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-12-14 21:42:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 21:42:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 21:42:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 21:42:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:42:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:42:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:42:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:42:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:42:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:42:54 [DEBUG   ] Finished updating board flags in 1.528 seconds
2018-12-14 21:43:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 21:43:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 21:43:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 21:43:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:43:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:43:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:43:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:43:54 [WARNING ] (13, 1, 'bot')
2018-12-14 21:43:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:43:54 [DEBUG   ] Finished updating board flags in 1.539 seconds
2018-12-14 21:44:11 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-12-14 21:44:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:44:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:44:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:44:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:44:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:44:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:44:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:44:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:44:55 [DEBUG   ] Finished updating board flags in 2.263 seconds
2018-12-14 21:45:04 [DEBUG   ] Got command RPT from MCS: ref #839112
2018-12-14 21:45:04 [DEBUG   ] summary = ERROR
2018-12-14 21:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839112  13 58466 78304918 A  ERRORERROR'
2018-12-14 21:45:05 [DEBUG   ] Got command RPT from MCS: ref #839113
2018-12-14 21:45:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839113  77 58466 78305121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:45:05 [DEBUG   ] Got command RPT from MCS: ref #839114
2018-12-14 21:45:05 [DEBUG   ] summary = ERROR
2018-12-14 21:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839114  13 58466 78305313 A  ERRORERROR'
2018-12-14 21:45:05 [DEBUG   ] Got command RPT from MCS: ref #839115
2018-12-14 21:45:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839115  77 58466 78305517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:45:05 [DEBUG   ] Got command RPT from MCS: ref #839116
2018-12-14 21:45:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839116  12 58466 78305721 A  ERRORB”™š'
2018-12-14 21:45:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 21:45:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 21:45:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 21:45:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:45:54 [DEBUG   ] Got command RPT from MCS: ref #839117
2018-12-14 21:45:54 [DEBUG   ] summary = ERROR
2018-12-14 21:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839117  13 58466 78354705 A  ERRORERROR'
2018-12-14 21:45:54 [DEBUG   ] Got command RPT from MCS: ref #839118
2018-12-14 21:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839118  77 58466 78354706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:45:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:45:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:45:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:45:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:45:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:45:55 [DEBUG   ] Finished updating board flags in 2.077 seconds
2018-12-14 21:46:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 21:46:32 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 21:46:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 21:46:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:46:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:46:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:46:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:46:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:46:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:46:55 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-12-14 21:47:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 21:47:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 21:47:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 21:47:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:47:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:47:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:47:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:47:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:47:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:47:55 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-12-14 21:48:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 21:48:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 21:48:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 21:48:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:48:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:48:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:48:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:48:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:48:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:48:55 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-14 21:49:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 21:49:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 21:49:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 21:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 21:49:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:49:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:49:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:49:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:49:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:49:55 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-14 21:50:04 [DEBUG   ] Got command RPT from MCS: ref #839140
2018-12-14 21:50:04 [DEBUG   ] summary = ERROR
2018-12-14 21:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839140  13 58466 78604997 A  ERRORERROR'
2018-12-14 21:50:05 [DEBUG   ] Got command RPT from MCS: ref #839141
2018-12-14 21:50:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839141  77 58466 78605201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:50:05 [DEBUG   ] Got command RPT from MCS: ref #839142
2018-12-14 21:50:05 [DEBUG   ] summary = ERROR
2018-12-14 21:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839142  13 58466 78605393 A  ERRORERROR'
2018-12-14 21:50:05 [DEBUG   ] Got command RPT from MCS: ref #839144
2018-12-14 21:50:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839144  77 58466 78605597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:50:05 [DEBUG   ] Got command RPT from MCS: ref #839145
2018-12-14 21:50:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839145  12 58466 78605801 A  ERRORB”™š'
2018-12-14 21:50:12 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-14 21:50:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 21:50:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 21:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:50:54 [DEBUG   ] Got command RPT from MCS: ref #839154
2018-12-14 21:50:54 [DEBUG   ] summary = ERROR
2018-12-14 21:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839154  13 58466 78654713 A  ERRORERROR'
2018-12-14 21:50:54 [DEBUG   ] Got command RPT from MCS: ref #839155
2018-12-14 21:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839155  77 58466 78654714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:50:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:50:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:50:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:50:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:50:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:50:55 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-12-14 21:51:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 21:51:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 21:51:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 21:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:51:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 21:51:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:51:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:51:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:51:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:51:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:51:55 [DEBUG   ] Finished updating board flags in 1.670 seconds
2018-12-14 21:52:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 21:52:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 21:52:52 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 21:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:52:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:52:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:52:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:52:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:52:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:52:55 [DEBUG   ] Finished updating board flags in 1.529 seconds
2018-12-14 21:53:13 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2018-12-14 21:53:33 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 21:53:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 21:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:53:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:53:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:53:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:53:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:53:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:53:55 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-12-14 21:54:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 21:54:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 21:54:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 21:54:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-12-14 21:54:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:54:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:54:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:54:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:54:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:54:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:54:55 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-12-14 21:55:05 [DEBUG   ] Got command RPT from MCS: ref #839175
2018-12-14 21:55:05 [DEBUG   ] summary = ERROR
2018-12-14 21:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839175  13 58466 78905077 A  ERRORERROR'
2018-12-14 21:55:05 [DEBUG   ] Got command RPT from MCS: ref #839176
2018-12-14 21:55:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839176  77 58466 78905281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:55:05 [DEBUG   ] Got command RPT from MCS: ref #839177
2018-12-14 21:55:05 [DEBUG   ] summary = ERROR
2018-12-14 21:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839177  13 58466 78905485 A  ERRORERROR'
2018-12-14 21:55:05 [DEBUG   ] Got command RPT from MCS: ref #839178
2018-12-14 21:55:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839178  77 58466 78905677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:55:05 [DEBUG   ] Got command RPT from MCS: ref #839179
2018-12-14 21:55:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 21:55:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839179  12 58466 78905881 A  ERRORB”™š'
2018-12-14 21:55:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 21:55:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 21:55:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 21:55:54 [DEBUG   ] Got command RPT from MCS: ref #839180
2018-12-14 21:55:54 [DEBUG   ] summary = ERROR
2018-12-14 21:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839180  13 58466 78954714 A  ERRORERROR'
2018-12-14 21:55:54 [DEBUG   ] Got command RPT from MCS: ref #839181
2018-12-14 21:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 21:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839181  77 58466 78954714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 21:55:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:55:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:55:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:55:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:55:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:55:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:55:55 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-12-14 21:56:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 21:56:33 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-14 21:56:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 21:56:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:56:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:56:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:56:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:56:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:56:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:56:55 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-14 21:57:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 21:57:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 21:57:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 21:57:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:57:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:57:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:57:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:57:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:57:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:57:55 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-14 21:58:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 21:58:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 21:58:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 21:58:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:58:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:58:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:58:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:58:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:58:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:58:55 [DEBUG   ] Finished updating board flags in 1.444 seconds
2018-12-14 21:59:14 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-14 21:59:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 21:59:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 21:59:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 21:59:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:59:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:59:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:59:55 [WARNING ] (13, 1, 'bot')
2018-12-14 21:59:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 21:59:55 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-12-14 22:00:05 [DEBUG   ] Got command RPT from MCS: ref #839207
2018-12-14 22:00:05 [DEBUG   ] summary = ERROR
2018-12-14 22:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839207  13 58466 79205157 A  ERRORERROR'
2018-12-14 22:00:05 [DEBUG   ] Got command RPT from MCS: ref #839208
2018-12-14 22:00:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839208  77 58466 79205361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:00:05 [DEBUG   ] Got command RPT from MCS: ref #839209
2018-12-14 22:00:05 [DEBUG   ] summary = ERROR
2018-12-14 22:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839209  13 58466 79205553 A  ERRORERROR'
2018-12-14 22:00:05 [DEBUG   ] Got command RPT from MCS: ref #839211
2018-12-14 22:00:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839211  77 58466 79205757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:00:05 [DEBUG   ] Got command RPT from MCS: ref #839213
2018-12-14 22:00:05 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839213  12 58466 79205961 A  ERRORB—™š'
2018-12-14 22:00:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 22:00:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 22:00:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 22:00:54 [DEBUG   ] Got command RPT from MCS: ref #839217
2018-12-14 22:00:54 [DEBUG   ] summary = ERROR
2018-12-14 22:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839217  13 58466 79254714 A  ERRORERROR'
2018-12-14 22:00:54 [DEBUG   ] Got command RPT from MCS: ref #839218
2018-12-14 22:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839218  77 58466 79254714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:00:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:00:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:00:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:00:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:00:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:00:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:00:55 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-14 22:01:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 22:01:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 22:01:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 22:01:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:01:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 22:01:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:01:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:01:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:01:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:01:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:01:55 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-12-14 22:02:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 22:02:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 22:02:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 22:02:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:02:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:02:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:02:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:02:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:02:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:02:55 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-12-14 22:03:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 22:03:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 22:03:54 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2018-12-14 22:03:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:03:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:03:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:03:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:03:55 [WARNING ] (13, 1, 'bot')
2018-12-14 22:03:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:03:55 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-12-14 22:04:15 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 22:04:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 22:04:55 [DEBUG   ] Finished updating ant stats in 1.257 seconds
2018-12-14 22:04:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:04:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:04:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:04:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:04:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:04:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:04:56 [DEBUG   ] Finished updating board flags in 2.199 seconds
2018-12-14 22:05:05 [DEBUG   ] Got command RPT from MCS: ref #839238
2018-12-14 22:05:05 [DEBUG   ] summary = ERROR
2018-12-14 22:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839238  13 58466 79505237 A  ERRORERROR'
2018-12-14 22:05:05 [DEBUG   ] Got command RPT from MCS: ref #839239
2018-12-14 22:05:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839239  77 58466 79505441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:05:05 [DEBUG   ] Got command RPT from MCS: ref #839240
2018-12-14 22:05:05 [DEBUG   ] summary = ERROR
2018-12-14 22:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839240  13 58466 79505645 A  ERRORERROR'
2018-12-14 22:05:05 [DEBUG   ] Got command RPT from MCS: ref #839241
2018-12-14 22:05:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:05:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839241  77 58466 79505837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:05:06 [DEBUG   ] Got command RPT from MCS: ref #839242
2018-12-14 22:05:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839242  12 58466 79506041 A  ERRORB—™š'
2018-12-14 22:05:15 [DEBUG   ] Finished updating ant stats in 1.147 seconds
2018-12-14 22:05:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 22:05:54 [DEBUG   ] Got command RPT from MCS: ref #839247
2018-12-14 22:05:54 [DEBUG   ] summary = ERROR
2018-12-14 22:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839247  13 58466 79554713 A  ERRORERROR'
2018-12-14 22:05:54 [DEBUG   ] Got command RPT from MCS: ref #839248
2018-12-14 22:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839248  77 58466 79554714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:05:55 [DEBUG   ] Finished updating ant stats in 0.811 seconds
2018-12-14 22:05:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:05:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:05:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:05:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:05:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:05:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:05:56 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-12-14 22:06:15 [DEBUG   ] Finished updating ant stats in 0.752 seconds
2018-12-14 22:06:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 22:06:55 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-12-14 22:06:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:06:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:06:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:06:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:06:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:06:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:06:56 [DEBUG   ] Finished updating board flags in 1.966 seconds
2018-12-14 22:07:16 [DEBUG   ] Finished updating ant stats in 1.285 seconds
2018-12-14 22:07:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 22:07:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:07:56 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-12-14 22:07:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:07:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:07:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:07:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:07:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:07:56 [DEBUG   ] Finished updating board flags in 1.881 seconds
2018-12-14 22:08:16 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-12-14 22:08:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 22:08:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:08:56 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2018-12-14 22:08:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:08:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:08:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:08:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:08:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:08:56 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-12-14 22:09:16 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-12-14 22:09:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 22:09:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:09:56 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-12-14 22:09:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:09:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:09:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:09:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:09:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:09:56 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-12-14 22:10:05 [DEBUG   ] Got command RPT from MCS: ref #839270
2018-12-14 22:10:05 [DEBUG   ] summary = ERROR
2018-12-14 22:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839270  13 58466 79805321 A  ERRORERROR'
2018-12-14 22:10:05 [DEBUG   ] Got command RPT from MCS: ref #839271
2018-12-14 22:10:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839271  77 58466 79805525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:10:05 [DEBUG   ] Got command RPT from MCS: ref #839272
2018-12-14 22:10:05 [DEBUG   ] summary = ERROR
2018-12-14 22:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839272  13 58466 79805717 A  ERRORERROR'
2018-12-14 22:10:05 [DEBUG   ] Got command RPT from MCS: ref #839274
2018-12-14 22:10:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:10:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839274  77 58466 79805921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:10:06 [DEBUG   ] Got command RPT from MCS: ref #839275
2018-12-14 22:10:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839275  12 58466 79806125 A  ERRORB–™š'
2018-12-14 22:10:16 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-12-14 22:10:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 22:10:54 [DEBUG   ] Got command RPT from MCS: ref #839280
2018-12-14 22:10:54 [DEBUG   ] summary = ERROR
2018-12-14 22:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839280  13 58466 79854717 A  ERRORERROR'
2018-12-14 22:10:54 [DEBUG   ] Got command RPT from MCS: ref #839281
2018-12-14 22:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839281  77 58466 79854718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:10:57 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2018-12-14 22:10:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:10:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:10:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:10:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:10:57 [DEBUG   ] Finished updating board flags in 2.418 seconds
2018-12-14 22:11:17 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2018-12-14 22:11:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 22:11:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:11:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:11:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:11:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:11:56 [WARNING ] (13, 1, 'bot')
2018-12-14 22:11:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:11:56 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-12-14 22:11:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 22:12:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 22:12:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 22:12:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 22:12:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:12:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:12:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:12:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:12:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:12:58 [DEBUG   ] Finished updating board flags in 2.600 seconds
2018-12-14 22:13:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 22:13:37 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 22:13:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:13:57 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2018-12-14 22:13:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:13:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:13:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:13:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:13:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:13:57 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-12-14 22:14:17 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2018-12-14 22:14:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 22:14:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:14:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:14:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:14:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:14:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:14:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:14:57 [DEBUG   ] Finished updating board flags in 2.191 seconds
2018-12-14 22:14:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 22:15:05 [DEBUG   ] Got command RPT from MCS: ref #839305
2018-12-14 22:15:05 [DEBUG   ] summary = ERROR
2018-12-14 22:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839305  13 58466 80105401 A  ERRORERROR'
2018-12-14 22:15:05 [DEBUG   ] Got command RPT from MCS: ref #839306
2018-12-14 22:15:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839306  77 58466 80105593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:15:05 [DEBUG   ] Got command RPT from MCS: ref #839307
2018-12-14 22:15:05 [DEBUG   ] summary = ERROR
2018-12-14 22:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839307  13 58466 80105797 A  ERRORERROR'
2018-12-14 22:15:06 [DEBUG   ] Got command RPT from MCS: ref #839308
2018-12-14 22:15:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839308  77 58466 80106001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:15:06 [DEBUG   ] Got command RPT from MCS: ref #839309
2018-12-14 22:15:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839309  12 58466 80106205 A  ERRORB•™š'
2018-12-14 22:15:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 22:15:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 22:15:54 [DEBUG   ] Got command RPT from MCS: ref #839310
2018-12-14 22:15:54 [DEBUG   ] summary = ERROR
2018-12-14 22:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839310  13 58466 80154713 A  ERRORERROR'
2018-12-14 22:15:54 [DEBUG   ] Got command RPT from MCS: ref #839311
2018-12-14 22:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839311  77 58466 80154714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:15:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:15:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:15:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:15:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:15:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:15:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:15:57 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-12-14 22:15:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 22:16:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 22:16:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 22:16:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 22:16:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:16:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:16:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:16:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:16:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:16:57 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-12-14 22:16:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 22:17:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 22:17:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 22:17:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:17:58 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2018-12-14 22:17:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:17:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:17:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:17:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:17:58 [DEBUG   ] Finished updating board flags in 2.530 seconds
2018-12-14 22:18:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 22:18:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 22:18:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:18:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:18:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:18:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:18:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:18:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:18:57 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-12-14 22:18:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 22:19:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 22:19:39 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 22:19:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:19:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:19:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:19:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:19:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:19:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:19:57 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-14 22:19:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 22:20:05 [DEBUG   ] Got command RPT from MCS: ref #839333
2018-12-14 22:20:05 [DEBUG   ] summary = ERROR
2018-12-14 22:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839333  13 58466 80405473 A  ERRORERROR'
2018-12-14 22:20:05 [DEBUG   ] Got command RPT from MCS: ref #839334
2018-12-14 22:20:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839334  77 58466 80405677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:20:05 [DEBUG   ] Got command RPT from MCS: ref #839335
2018-12-14 22:20:05 [DEBUG   ] summary = ERROR
2018-12-14 22:20:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839335  13 58466 80405881 A  ERRORERROR'
2018-12-14 22:20:06 [DEBUG   ] Got command RPT from MCS: ref #839337
2018-12-14 22:20:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839337  77 58466 80406085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:20:06 [DEBUG   ] Got command RPT from MCS: ref #839338
2018-12-14 22:20:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839338  12 58466 80406277 A  ERRORB•™š'
2018-12-14 22:20:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 22:20:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 22:20:54 [DEBUG   ] Got command RPT from MCS: ref #839347
2018-12-14 22:20:54 [DEBUG   ] summary = ERROR
2018-12-14 22:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839347  13 58466 80454721 A  ERRORERROR'
2018-12-14 22:20:54 [DEBUG   ] Got command RPT from MCS: ref #839348
2018-12-14 22:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839348  77 58466 80454722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:20:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:20:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:20:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:20:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:20:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:20:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:20:57 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-12-14 22:20:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 22:21:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 22:21:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 22:21:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:21:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:21:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:21:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:21:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:21:57 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-14 22:21:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 22:22:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 22:22:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 22:22:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:22:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 22:22:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:22:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:22:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:22:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:22:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:22:57 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-12-14 22:22:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 22:23:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 22:23:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 22:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:23:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:23:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:23:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:23:57 [WARNING ] (13, 1, 'bot')
2018-12-14 22:23:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:23:57 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-12-14 22:23:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 22:24:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 22:24:39 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 22:24:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:24:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:24:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:24:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:24:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:24:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:24:58 [DEBUG   ] Finished updating board flags in 2.215 seconds
2018-12-14 22:24:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 22:25:05 [DEBUG   ] Got command RPT from MCS: ref #839368
2018-12-14 22:25:05 [DEBUG   ] summary = ERROR
2018-12-14 22:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839368  13 58466 80705557 A  ERRORERROR'
2018-12-14 22:25:05 [DEBUG   ] Got command RPT from MCS: ref #839369
2018-12-14 22:25:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839369  77 58466 80705761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:25:05 [DEBUG   ] Got command RPT from MCS: ref #839370
2018-12-14 22:25:05 [DEBUG   ] summary = ERROR
2018-12-14 22:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839370  13 58466 80705965 A  ERRORERROR'
2018-12-14 22:25:06 [DEBUG   ] Got command RPT from MCS: ref #839371
2018-12-14 22:25:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839371  77 58466 80706157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:25:06 [DEBUG   ] Got command RPT from MCS: ref #839372
2018-12-14 22:25:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839372  12 58466 80706361 A  ERRORB”™š'
2018-12-14 22:25:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 22:25:40 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 22:25:54 [DEBUG   ] Got command RPT from MCS: ref #839373
2018-12-14 22:25:54 [DEBUG   ] summary = ERROR
2018-12-14 22:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839373  13 58466 80754725 A  ERRORERROR'
2018-12-14 22:25:54 [DEBUG   ] Got command RPT from MCS: ref #839374
2018-12-14 22:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839374  77 58466 80754726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:25:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:25:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:25:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:25:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:25:58 [DEBUG   ] Finished updating board flags in 2.122 seconds
2018-12-14 22:26:00 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2018-12-14 22:26:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 22:26:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 22:26:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:26:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:26:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:26:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:26:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:26:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:26:58 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-12-14 22:27:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 22:27:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 22:27:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 22:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:27:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:27:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:27:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:27:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:27:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:27:58 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-12-14 22:28:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 22:28:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 22:28:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 22:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:28:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:28:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:28:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:28:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:28:58 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-14 22:29:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 22:29:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 22:29:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 22:29:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:29:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:29:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:29:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:29:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:29:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:29:58 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-14 22:30:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 22:30:05 [DEBUG   ] Got command RPT from MCS: ref #839400
2018-12-14 22:30:05 [DEBUG   ] summary = ERROR
2018-12-14 22:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839400  13 58466 81005637 A  ERRORERROR'
2018-12-14 22:30:05 [DEBUG   ] Got command RPT from MCS: ref #839401
2018-12-14 22:30:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:30:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839401  77 58466 81005841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:30:06 [DEBUG   ] Got command RPT from MCS: ref #839402
2018-12-14 22:30:06 [DEBUG   ] summary = ERROR
2018-12-14 22:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839402  13 58466 81006045 A  ERRORERROR'
2018-12-14 22:30:06 [DEBUG   ] Got command RPT from MCS: ref #839404
2018-12-14 22:30:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839404  77 58466 81006237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:30:06 [DEBUG   ] Got command RPT from MCS: ref #839406
2018-12-14 22:30:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839406  12 58466 81006453 A  ERRORB”™š'
2018-12-14 22:30:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 22:30:41 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 22:30:54 [DEBUG   ] Got command RPT from MCS: ref #839410
2018-12-14 22:30:54 [DEBUG   ] summary = ERROR
2018-12-14 22:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839410  13 58466 81054725 A  ERRORERROR'
2018-12-14 22:30:54 [DEBUG   ] Got command RPT from MCS: ref #839411
2018-12-14 22:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839411  77 58466 81054726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:30:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:30:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:30:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:30:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:30:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:30:58 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-12-14 22:31:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 22:31:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 22:31:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 22:31:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:31:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:31:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:31:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:31:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:31:58 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-14 22:32:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 22:32:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 22:32:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 22:32:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:32:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 22:32:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:32:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:32:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:32:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:32:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:32:58 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-12-14 22:33:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-14 22:33:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 22:33:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 22:33:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 22:33:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:33:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:33:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:33:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:33:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:33:58 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-14 22:34:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 22:34:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 22:34:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 22:34:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:34:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:34:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:34:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:34:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:34:58 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-12-14 22:35:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 22:35:05 [DEBUG   ] Got command RPT from MCS: ref #839431
2018-12-14 22:35:05 [DEBUG   ] summary = ERROR
2018-12-14 22:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839431  13 58466 81305721 A  ERRORERROR'
2018-12-14 22:35:05 [DEBUG   ] Got command RPT from MCS: ref #839432
2018-12-14 22:35:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839432  77 58466 81305925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:35:06 [DEBUG   ] Got command RPT from MCS: ref #839433
2018-12-14 22:35:06 [DEBUG   ] summary = ERROR
2018-12-14 22:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839433  13 58466 81306117 A  ERRORERROR'
2018-12-14 22:35:06 [DEBUG   ] Got command RPT from MCS: ref #839434
2018-12-14 22:35:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839434  77 58466 81306321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:35:06 [DEBUG   ] Got command RPT from MCS: ref #839435
2018-12-14 22:35:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839435  12 58466 81306525 A  ERRORB“™š'
2018-12-14 22:35:22 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-12-14 22:35:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 22:35:54 [DEBUG   ] Got command RPT from MCS: ref #839440
2018-12-14 22:35:54 [DEBUG   ] summary = ERROR
2018-12-14 22:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839440  13 58466 81354717 A  ERRORERROR'
2018-12-14 22:35:54 [DEBUG   ] Got command RPT from MCS: ref #839441
2018-12-14 22:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839441  77 58466 81354718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:35:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:35:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:35:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:35:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:35:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:35:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:35:58 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-12-14 22:36:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 22:36:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 22:36:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 22:36:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:36:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:36:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:36:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:36:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:36:59 [DEBUG   ] Finished updating board flags in 2.201 seconds
2018-12-14 22:37:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 22:37:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 22:37:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 22:37:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:37:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:37:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:37:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:37:58 [WARNING ] (13, 1, 'bot')
2018-12-14 22:37:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:37:58 [DEBUG   ] Finished updating board flags in 1.319 seconds
2018-12-14 22:38:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 22:38:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 22:38:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 22:38:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:38:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:38:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:38:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:38:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:38:59 [DEBUG   ] Finished updating board flags in 2.097 seconds
2018-12-14 22:39:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 22:39:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 22:39:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 22:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:39:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:39:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:39:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:39:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:39:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:39:59 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-12-14 22:40:02 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-12-14 22:40:05 [DEBUG   ] Got command RPT from MCS: ref #839463
2018-12-14 22:40:05 [DEBUG   ] summary = ERROR
2018-12-14 22:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839463  13 58466 81605805 A  ERRORERROR'
2018-12-14 22:40:05 [DEBUG   ] Got command RPT from MCS: ref #839464
2018-12-14 22:40:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:40:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839464  77 58466 81605997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:40:06 [DEBUG   ] Got command RPT from MCS: ref #839465
2018-12-14 22:40:06 [DEBUG   ] summary = ERROR
2018-12-14 22:40:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839465  13 58466 81606201 A  ERRORERROR'
2018-12-14 22:40:06 [DEBUG   ] Got command RPT from MCS: ref #839467
2018-12-14 22:40:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:40:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839467  77 58466 81606405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:40:06 [DEBUG   ] Got command RPT from MCS: ref #839468
2018-12-14 22:40:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:40:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839468  12 58466 81606609 A  ERRORB•™š'
2018-12-14 22:40:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 22:40:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 22:40:54 [DEBUG   ] Got command RPT from MCS: ref #839473
2018-12-14 22:40:54 [DEBUG   ] summary = ERROR
2018-12-14 22:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839473  13 58466 81654717 A  ERRORERROR'
2018-12-14 22:40:54 [DEBUG   ] Got command RPT from MCS: ref #839474
2018-12-14 22:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839474  77 58466 81654718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:40:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 22:40:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:40:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:40:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:40:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:40:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:40:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:40:59 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-12-14 22:41:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 22:41:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 22:41:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 22:41:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-14 22:41:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:41:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:41:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:41:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:41:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:41:59 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-14 22:42:03 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 22:42:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 22:42:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 22:42:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:42:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:42:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:42:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:42:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:42:59 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-14 22:43:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 22:43:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 22:43:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 22:43:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 22:43:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:43:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:43:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:43:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:43:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:43:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:43:59 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-14 22:44:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 22:44:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 22:44:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 22:44:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:44:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:44:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:44:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:44:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:44:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:44:59 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-12-14 22:45:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 22:45:05 [DEBUG   ] Got command RPT from MCS: ref #839498
2018-12-14 22:45:05 [DEBUG   ] summary = ERROR
2018-12-14 22:45:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839498  13 58466 81905881 A  ERRORERROR'
2018-12-14 22:45:06 [DEBUG   ] Got command RPT from MCS: ref #839499
2018-12-14 22:45:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839499  77 58466 81906085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:45:06 [DEBUG   ] Got command RPT from MCS: ref #839500
2018-12-14 22:45:06 [DEBUG   ] summary = ERROR
2018-12-14 22:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839500  13 58466 81906277 A  ERRORERROR'
2018-12-14 22:45:06 [DEBUG   ] Got command RPT from MCS: ref #839501
2018-12-14 22:45:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839501  77 58466 81906481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:45:06 [DEBUG   ] Got command RPT from MCS: ref #839502
2018-12-14 22:45:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839502  12 58466 81906685 A  ERRORB—™š'
2018-12-14 22:45:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 22:45:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 22:45:54 [DEBUG   ] Got command RPT from MCS: ref #839503
2018-12-14 22:45:54 [DEBUG   ] summary = ERROR
2018-12-14 22:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839503  13 58466 81954725 A  ERRORERROR'
2018-12-14 22:45:54 [DEBUG   ] Got command RPT from MCS: ref #839504
2018-12-14 22:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839504  77 58466 81954726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 22:45:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:45:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:45:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:45:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:45:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:45:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:45:59 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-14 22:46:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 22:46:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 22:46:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 22:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 22:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:46:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 22:46:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:46:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:46:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:46:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:46:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:46:59 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-12-14 22:47:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 22:47:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 22:47:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-14 22:47:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 22:47:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:47:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:47:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:47:59 [WARNING ] (13, 1, 'bot')
2018-12-14 22:47:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:47:59 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-12-14 22:48:04 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-12-14 22:48:12 [DEBUG   ] Got command TBW from MCS: ref #839525
2018-12-14 22:48:12 [DEBUG   ] tbw = exited with status True, code 0x00
2018-12-14 22:48:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   839525   8 58466 82092017 A  ERROR'
2018-12-14 22:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-12-14 22:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-12-14 22:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-12-14 22:48:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-12-14 22:48:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-12-14 22:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-12-14 22:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-12-14 22:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-12-14 22:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-12-14 22:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-12-14 22:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-12-14 22:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-12-14 22:48:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-12-14 22:48:15 [DEBUG   ] spawn_process: at 2018-12-14 22:48:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-12-14 22:48:15 [INFO    ] Finished spawning TBW
2018-12-14 22:48:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:49:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:49:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:49:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:49:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:49:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:49:00 [DEBUG   ] Finished updating board flags in 1.921 seconds
2018-12-14 22:49:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:50:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:50:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:50:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:50:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:50:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:50:00 [DEBUG   ] Finished updating board flags in 1.880 seconds
2018-12-14 22:50:03 [INFO    ] __waitForTBW - TBW finished in 108.233 s
2018-12-14 22:50:04 [DEBUG   ] Finished updating ant stats in 0.490 seconds
2018-12-14 22:50:04 [INFO    ] Started antennas statistics background thread
2018-12-14 22:50:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1544827806']
2018-12-14 22:50:04 [DEBUG   ] spawn_process: at 2018-12-14 22:50:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1544827806']
2018-12-14 22:50:04 [INFO    ] Finished spawning TBN in 0.050 s
2018-12-14 22:50:05 [DEBUG   ] Got command RPT from MCS: ref #839532
2018-12-14 22:50:05 [DEBUG   ] summary = ERROR
2018-12-14 22:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839532  13 58466 82205957 A  ERRORERROR'
2018-12-14 22:50:06 [DEBUG   ] Got command RPT from MCS: ref #839533
2018-12-14 22:50:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839533  77 58466 82206161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:50:06 [DEBUG   ] Got command RPT from MCS: ref #839534
2018-12-14 22:50:06 [DEBUG   ] summary = ERROR
2018-12-14 22:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839534  13 58466 82206365 A  ERRORERROR'
2018-12-14 22:50:06 [DEBUG   ] Got command RPT from MCS: ref #839536
2018-12-14 22:50:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839536  77 58466 82206557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:50:06 [DEBUG   ] Got command RPT from MCS: ref #839538
2018-12-14 22:50:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839538  12 58466 82206761 A  ERRORB–™š'
2018-12-14 22:50:24 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2018-12-14 22:50:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 22:50:54 [DEBUG   ] Got command RPT from MCS: ref #839549
2018-12-14 22:50:54 [DEBUG   ] summary = ERROR
2018-12-14 22:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839549  13 58466 82254721 A  ERRORERROR'
2018-12-14 22:50:54 [DEBUG   ] Got command RPT from MCS: ref #839550
2018-12-14 22:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839550  77 58466 82254722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:50:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:51:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:51:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:51:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:51:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:51:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:51:00 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-12-14 22:51:04 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 22:51:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 22:51:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 22:51:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:52:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:52:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:52:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:52:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:52:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:52:00 [DEBUG   ] Finished updating board flags in 1.648 seconds
2018-12-14 22:52:05 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-14 22:52:24 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 22:52:45 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-12-14 22:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:53:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:53:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:53:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:53:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:53:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:53:00 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-12-14 22:53:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 22:53:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 22:53:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 22:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:54:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:54:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:54:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:54:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:54:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:54:00 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-14 22:54:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 22:54:25 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 22:54:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 22:54:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:55:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:55:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:55:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:55:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:55:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:55:00 [DEBUG   ] Finished updating board flags in 1.576 seconds
2018-12-14 22:55:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 22:55:06 [DEBUG   ] Got command RPT from MCS: ref #839570
2018-12-14 22:55:06 [DEBUG   ] summary = ERROR
2018-12-14 22:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839570  13 58466 82506037 A  ERRORERROR'
2018-12-14 22:55:06 [DEBUG   ] Got command RPT from MCS: ref #839571
2018-12-14 22:55:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839571  77 58466 82506241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:55:06 [DEBUG   ] Got command RPT from MCS: ref #839572
2018-12-14 22:55:06 [DEBUG   ] summary = ERROR
2018-12-14 22:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839572  13 58466 82506445 A  ERRORERROR'
2018-12-14 22:55:06 [DEBUG   ] Got command RPT from MCS: ref #839573
2018-12-14 22:55:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839573  77 58466 82506649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:55:06 [DEBUG   ] Got command RPT from MCS: ref #839574
2018-12-14 22:55:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 22:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839574  12 58466 82506841 A  ERRORB•™š'
2018-12-14 22:55:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 22:55:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 22:55:54 [DEBUG   ] Got command RPT from MCS: ref #839575
2018-12-14 22:55:54 [DEBUG   ] summary = ERROR
2018-12-14 22:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839575  13 58466 82554725 A  ERRORERROR'
2018-12-14 22:55:54 [DEBUG   ] Got command RPT from MCS: ref #839576
2018-12-14 22:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 22:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839576  77 58466 82554726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 22:55:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:56:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:56:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:56:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:56:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:56:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:56:00 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-14 22:56:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 22:56:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 22:56:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 22:56:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:57:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:57:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:57:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:57:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:57:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:57:00 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-12-14 22:57:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 22:57:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 22:57:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 22:58:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:58:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:58:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:58:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:58:00 [WARNING ] (13, 1, 'bot')
2018-12-14 22:58:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:58:00 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-12-14 22:58:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 22:58:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 22:58:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 22:59:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 22:59:01 [WARNING ] (13, 1, 'bot')
2018-12-14 22:59:01 [WARNING ] (13, 1, 'bot')
2018-12-14 22:59:01 [WARNING ] (13, 1, 'bot')
2018-12-14 22:59:01 [WARNING ] (13, 1, 'bot')
2018-12-14 22:59:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 22:59:01 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-12-14 22:59:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 22:59:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 22:59:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 23:00:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 23:00:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:00:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:00:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:00:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:00:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:00:01 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-12-14 23:00:06 [DEBUG   ] Got command RPT from MCS: ref #839602
2018-12-14 23:00:06 [DEBUG   ] summary = ERROR
2018-12-14 23:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839602  13 58466 82806121 A  ERRORERROR'
2018-12-14 23:00:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 23:00:06 [DEBUG   ] Got command RPT from MCS: ref #839603
2018-12-14 23:00:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839603  77 58466 82806326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:00:06 [DEBUG   ] Got command RPT from MCS: ref #839604
2018-12-14 23:00:06 [DEBUG   ] summary = ERROR
2018-12-14 23:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839604  13 58466 82806517 A  ERRORERROR'
2018-12-14 23:00:06 [DEBUG   ] Got command RPT from MCS: ref #839606
2018-12-14 23:00:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839606  77 58466 82806721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:00:06 [DEBUG   ] Got command RPT from MCS: ref #839608
2018-12-14 23:00:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:00:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839608  12 58466 82806925 A  ERRORB•™š'
2018-12-14 23:00:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:00:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 23:00:54 [DEBUG   ] Got command RPT from MCS: ref #839612
2018-12-14 23:00:54 [DEBUG   ] summary = ERROR
2018-12-14 23:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839612  13 58466 82854729 A  ERRORERROR'
2018-12-14 23:00:54 [DEBUG   ] Got command RPT from MCS: ref #839613
2018-12-14 23:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839613  77 58466 82854730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:01:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:01:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:01:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:01:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:01:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:01:01 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-12-14 23:01:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 23:01:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 23:01:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 23:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:02:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:02:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:02:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:02:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:02:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:02:01 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-14 23:02:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 23:02:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 23:02:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 23:03:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:03:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:03:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:03:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:03:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:03:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:03:01 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-12-14 23:03:07 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-14 23:03:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-14 23:03:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 23:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:04:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:04:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:04:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:04:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:04:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:04:01 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-14 23:04:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 23:04:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 23:04:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 23:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:05:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:05:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:05:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:05:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:05:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:05:01 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-12-14 23:05:06 [DEBUG   ] Got command RPT from MCS: ref #839633
2018-12-14 23:05:06 [DEBUG   ] summary = ERROR
2018-12-14 23:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839633  13 58466 83106193 A  ERRORERROR'
2018-12-14 23:05:06 [DEBUG   ] Got command RPT from MCS: ref #839634
2018-12-14 23:05:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839634  77 58466 83106397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:05:06 [DEBUG   ] Got command RPT from MCS: ref #839635
2018-12-14 23:05:06 [DEBUG   ] summary = ERROR
2018-12-14 23:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839635  13 58466 83106601 A  ERRORERROR'
2018-12-14 23:05:06 [DEBUG   ] Got command RPT from MCS: ref #839636
2018-12-14 23:05:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839636  77 58466 83106805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:05:06 [DEBUG   ] Got command RPT from MCS: ref #839637
2018-12-14 23:05:06 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839637  12 58466 83106997 A  ERRORB•™š'
2018-12-14 23:05:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 23:05:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 23:05:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 23:05:54 [DEBUG   ] Got command RPT from MCS: ref #839642
2018-12-14 23:05:54 [DEBUG   ] summary = ERROR
2018-12-14 23:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839642  13 58466 83154729 A  ERRORERROR'
2018-12-14 23:05:54 [DEBUG   ] Got command RPT from MCS: ref #839643
2018-12-14 23:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839643  77 58466 83154730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:06:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:06:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:06:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:06:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:06:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:06:01 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-14 23:06:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 23:06:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 23:06:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 23:07:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:07:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:07:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:07:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:07:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:07:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:07:01 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-12-14 23:07:07 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-14 23:07:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 23:07:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 23:08:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:08:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:08:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:08:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:08:01 [WARNING ] (13, 1, 'bot')
2018-12-14 23:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:08:01 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-12-14 23:08:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 23:08:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 23:08:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 23:09:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:09:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:09:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:09:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:09:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:09:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:09:02 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-12-14 23:09:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 23:09:28 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 23:09:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 23:10:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:10:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:10:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:10:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:10:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:10:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:10:02 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-12-14 23:10:06 [DEBUG   ] Got command RPT from MCS: ref #839665
2018-12-14 23:10:06 [DEBUG   ] summary = ERROR
2018-12-14 23:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839665  13 58466 83406277 A  ERRORERROR'
2018-12-14 23:10:06 [DEBUG   ] Got command RPT from MCS: ref #839666
2018-12-14 23:10:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839666  77 58466 83406481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:10:06 [DEBUG   ] Got command RPT from MCS: ref #839667
2018-12-14 23:10:06 [DEBUG   ] summary = ERROR
2018-12-14 23:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839667  13 58466 83406685 A  ERRORERROR'
2018-12-14 23:10:06 [DEBUG   ] Got command RPT from MCS: ref #839669
2018-12-14 23:10:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:10:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839669  77 58466 83406877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:10:07 [DEBUG   ] Got command RPT from MCS: ref #839671
2018-12-14 23:10:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839671  12 58466 83407081 A  ERRORB”™š'
2018-12-14 23:10:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 23:10:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:10:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 23:10:54 [DEBUG   ] Got command RPT from MCS: ref #839675
2018-12-14 23:10:54 [DEBUG   ] summary = ERROR
2018-12-14 23:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839675  13 58466 83454729 A  ERRORERROR'
2018-12-14 23:10:54 [DEBUG   ] Got command RPT from MCS: ref #839676
2018-12-14 23:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839676  77 58466 83454730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 23:11:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:11:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:11:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:11:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:11:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:11:02 [DEBUG   ] Finished updating board flags in 1.958 seconds
2018-12-14 23:11:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:11:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 23:11:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 23:12:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:12:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:12:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:12:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:12:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:12:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:12:02 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-12-14 23:12:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 23:12:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 23:12:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 23:13:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:13:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:13:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:13:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:13:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:13:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:13:02 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-12-14 23:13:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 23:13:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 23:13:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 23:14:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:14:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:14:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:14:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:14:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:14:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:14:02 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-12-14 23:14:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 23:14:28 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 23:14:49 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-14 23:15:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:15:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:15:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:15:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:15:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:15:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:15:02 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-14 23:15:06 [DEBUG   ] Got command RPT from MCS: ref #839700
2018-12-14 23:15:06 [DEBUG   ] summary = ERROR
2018-12-14 23:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839700  13 58466 83706365 A  ERRORERROR'
2018-12-14 23:15:06 [DEBUG   ] Got command RPT from MCS: ref #839701
2018-12-14 23:15:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839701  77 58466 83706557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:15:06 [DEBUG   ] Got command RPT from MCS: ref #839702
2018-12-14 23:15:06 [DEBUG   ] summary = ERROR
2018-12-14 23:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839702  13 58466 83706761 A  ERRORERROR'
2018-12-14 23:15:06 [DEBUG   ] Got command RPT from MCS: ref #839703
2018-12-14 23:15:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:15:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839703  77 58466 83706965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:15:07 [DEBUG   ] Got command RPT from MCS: ref #839704
2018-12-14 23:15:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839704  12 58466 83707157 A  ERRORB”™š'
2018-12-14 23:15:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 23:15:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 23:15:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 23:15:54 [DEBUG   ] Got command RPT from MCS: ref #839705
2018-12-14 23:15:54 [DEBUG   ] summary = ERROR
2018-12-14 23:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839705  13 58466 83754725 A  ERRORERROR'
2018-12-14 23:15:54 [DEBUG   ] Got command RPT from MCS: ref #839706
2018-12-14 23:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839706  77 58466 83754726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:16:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:16:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:16:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:16:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:16:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:16:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:16:02 [DEBUG   ] Finished updating board flags in 1.567 seconds
2018-12-14 23:16:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 23:16:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:16:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 23:17:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:17:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:17:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:17:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:17:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:17:02 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-12-14 23:17:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 23:17:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 23:17:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 23:18:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:18:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:18:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:18:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:18:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:18:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:18:02 [DEBUG   ] Finished updating board flags in 1.370 seconds
2018-12-14 23:18:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 23:18:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 23:18:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 23:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 23:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-14 23:19:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:19:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:19:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:19:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:19:02 [WARNING ] (13, 1, 'bot')
2018-12-14 23:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:19:02 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-12-14 23:19:10 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-14 23:19:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 23:19:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 23:20:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:20:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:20:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:20:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:20:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:20:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:20:03 [DEBUG   ] Finished updating board flags in 2.032 seconds
2018-12-14 23:20:06 [DEBUG   ] Got command RPT from MCS: ref #839728
2018-12-14 23:20:06 [DEBUG   ] summary = ERROR
2018-12-14 23:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839728  13 58466 84006437 A  ERRORERROR'
2018-12-14 23:20:06 [DEBUG   ] Got command RPT from MCS: ref #839729
2018-12-14 23:20:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839729  77 58466 84006641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:20:06 [DEBUG   ] Got command RPT from MCS: ref #839730
2018-12-14 23:20:06 [DEBUG   ] summary = ERROR
2018-12-14 23:20:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839730  13 58466 84006845 A  ERRORERROR'
2018-12-14 23:20:07 [DEBUG   ] Got command RPT from MCS: ref #839732
2018-12-14 23:20:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839732  77 58466 84007037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:20:07 [DEBUG   ] Got command RPT from MCS: ref #839734
2018-12-14 23:20:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839734  12 58466 84007241 A  ERRORB–™š'
2018-12-14 23:20:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:20:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:20:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 23:20:54 [DEBUG   ] Got command RPT from MCS: ref #839742
2018-12-14 23:20:54 [DEBUG   ] summary = ERROR
2018-12-14 23:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839742  13 58466 84054733 A  ERRORERROR'
2018-12-14 23:20:54 [DEBUG   ] Got command RPT from MCS: ref #839743
2018-12-14 23:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839743  77 58466 84054734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:21:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:21:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:21:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:21:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:21:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:21:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:21:03 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-12-14 23:21:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-14 23:21:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 23:21:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 23:22:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:22:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:22:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:22:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:22:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:22:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:22:03 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-12-14 23:22:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-14 23:22:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 23:22:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 23:23:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:23:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:23:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:23:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:23:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:23:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:23:03 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-14 23:23:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 23:23:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 23:23:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 23:24:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:24:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:24:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:24:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:24:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:24:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:24:03 [DEBUG   ] Finished updating board flags in 1.847 seconds
2018-12-14 23:24:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 23:24:30 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-14 23:24:51 [DEBUG   ] Finished updating ant stats in 1.110 seconds
2018-12-14 23:25:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:25:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:25:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:25:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:25:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:25:03 [DEBUG   ] Finished updating board flags in 1.743 seconds
2018-12-14 23:25:06 [DEBUG   ] Got command RPT from MCS: ref #839763
2018-12-14 23:25:06 [DEBUG   ] summary = ERROR
2018-12-14 23:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839763  13 58466 84306521 A  ERRORERROR'
2018-12-14 23:25:06 [DEBUG   ] Got command RPT from MCS: ref #839764
2018-12-14 23:25:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839764  77 58466 84306725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:25:06 [DEBUG   ] Got command RPT from MCS: ref #839765
2018-12-14 23:25:06 [DEBUG   ] summary = ERROR
2018-12-14 23:25:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839765  13 58466 84306917 A  ERRORERROR'
2018-12-14 23:25:07 [DEBUG   ] Got command RPT from MCS: ref #839766
2018-12-14 23:25:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839766  77 58466 84307121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:25:07 [DEBUG   ] Got command RPT from MCS: ref #839767
2018-12-14 23:25:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839767  12 58466 84307325 A  ERRORB—™š'
2018-12-14 23:25:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 23:25:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 23:25:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 23:25:54 [DEBUG   ] Got command RPT from MCS: ref #839768
2018-12-14 23:25:54 [DEBUG   ] summary = ERROR
2018-12-14 23:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839768  13 58466 84354733 A  ERRORERROR'
2018-12-14 23:25:54 [DEBUG   ] Got command RPT from MCS: ref #839769
2018-12-14 23:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839769  77 58466 84354734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 23:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:26:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:26:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:26:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:26:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:26:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:26:03 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-12-14 23:26:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 23:26:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-14 23:26:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 23:27:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:27:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:27:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:27:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:27:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:27:03 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-12-14 23:27:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 23:27:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 23:27:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 23:28:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:28:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:28:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:28:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:28:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:28:03 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-12-14 23:28:11 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 23:28:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 23:28:52 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 23:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:29:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:29:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:29:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:29:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:29:03 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-12-14 23:29:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 23:29:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 23:29:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 23:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:30:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:30:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:30:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:30:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:30:03 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-12-14 23:30:06 [DEBUG   ] Got command RPT from MCS: ref #839795
2018-12-14 23:30:06 [DEBUG   ] summary = ERROR
2018-12-14 23:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839795  13 58466 84606605 A  ERRORERROR'
2018-12-14 23:30:06 [DEBUG   ] Got command RPT from MCS: ref #839796
2018-12-14 23:30:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:30:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839796  77 58466 84606798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:30:07 [DEBUG   ] Got command RPT from MCS: ref #839797
2018-12-14 23:30:07 [DEBUG   ] summary = ERROR
2018-12-14 23:30:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839797  13 58466 84607001 A  ERRORERROR'
2018-12-14 23:30:07 [DEBUG   ] Got command RPT from MCS: ref #839799
2018-12-14 23:30:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:30:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839799  77 58466 84607205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:30:07 [DEBUG   ] Got command RPT from MCS: ref #839800
2018-12-14 23:30:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:30:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839800  12 58466 84607397 A  ERRORB–™š'
2018-12-14 23:30:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 23:30:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 23:30:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-14 23:30:54 [DEBUG   ] Got command RPT from MCS: ref #839805
2018-12-14 23:30:54 [DEBUG   ] summary = ERROR
2018-12-14 23:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839805  13 58466 84654729 A  ERRORERROR'
2018-12-14 23:30:54 [DEBUG   ] Got command RPT from MCS: ref #839806
2018-12-14 23:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839806  77 58466 84654730 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:31:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 23:31:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:31:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:31:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:31:03 [WARNING ] (13, 1, 'bot')
2018-12-14 23:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:31:03 [DEBUG   ] Finished updating board flags in 1.460 seconds
2018-12-14 23:31:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 23:31:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 23:31:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 23:32:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:32:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:32:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:32:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:32:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:32:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:32:04 [DEBUG   ] Finished updating board flags in 2.215 seconds
2018-12-14 23:32:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 23:32:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 23:32:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 23:33:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:33:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-14 23:33:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:33:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:33:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:33:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:33:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:33:04 [DEBUG   ] Finished updating board flags in 2.133 seconds
2018-12-14 23:33:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 23:33:32 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-12-14 23:33:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-14 23:34:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:34:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:34:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:34:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:34:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:34:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:34:04 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-12-14 23:34:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 23:34:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 23:34:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:35:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:35:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:35:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:35:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:35:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:35:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:35:04 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-12-14 23:35:06 [DEBUG   ] Got command RPT from MCS: ref #839826
2018-12-14 23:35:06 [DEBUG   ] summary = ERROR
2018-12-14 23:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839826  13 58466 84906681 A  ERRORERROR'
2018-12-14 23:35:06 [DEBUG   ] Got command RPT from MCS: ref #839827
2018-12-14 23:35:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:35:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839827  77 58466 84906885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:35:07 [DEBUG   ] Got command RPT from MCS: ref #839828
2018-12-14 23:35:07 [DEBUG   ] summary = ERROR
2018-12-14 23:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839828  13 58466 84907077 A  ERRORERROR'
2018-12-14 23:35:07 [DEBUG   ] Got command RPT from MCS: ref #839829
2018-12-14 23:35:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839829  77 58466 84907281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:35:07 [DEBUG   ] Got command RPT from MCS: ref #839830
2018-12-14 23:35:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839830  12 58466 84907485 A  ERRORB–™š'
2018-12-14 23:35:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:35:33 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 23:35:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 23:35:54 [DEBUG   ] Got command RPT from MCS: ref #839835
2018-12-14 23:35:54 [DEBUG   ] summary = ERROR
2018-12-14 23:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839835  13 58466 84954733 A  ERRORERROR'
2018-12-14 23:35:54 [DEBUG   ] Got command RPT from MCS: ref #839836
2018-12-14 23:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839836  77 58466 84954734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:36:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:36:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:36:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:36:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:36:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:36:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:36:04 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-12-14 23:36:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-14 23:36:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 23:36:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 23:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:37:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:37:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:37:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:37:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:37:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:37:04 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-12-14 23:37:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 23:37:34 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-14 23:37:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 23:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:38:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:38:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:38:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:38:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:38:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:38:04 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-14 23:38:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-14 23:38:34 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2018-12-14 23:38:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 23:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:39:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:39:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:39:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:39:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:39:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:39:04 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-12-14 23:39:14 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-12-14 23:39:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-14 23:39:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 23:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:40:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:40:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:40:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:40:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:40:04 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-12-14 23:40:06 [DEBUG   ] Got command RPT from MCS: ref #839858
2018-12-14 23:40:06 [DEBUG   ] summary = ERROR
2018-12-14 23:40:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839858  13 58466 85206765 A  ERRORERROR'
2018-12-14 23:40:06 [DEBUG   ] Got command RPT from MCS: ref #839859
2018-12-14 23:40:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:40:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839859  77 58466 85206962 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:40:07 [DEBUG   ] Got command RPT from MCS: ref #839860
2018-12-14 23:40:07 [DEBUG   ] summary = ERROR
2018-12-14 23:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839860  13 58466 85207165 A  ERRORERROR'
2018-12-14 23:40:07 [DEBUG   ] Got command RPT from MCS: ref #839862
2018-12-14 23:40:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839862  77 58466 85207357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:40:07 [DEBUG   ] Got command RPT from MCS: ref #839864
2018-12-14 23:40:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839864  12 58466 85207561 A  ERRORB•™š'
2018-12-14 23:40:15 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 23:40:35 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-14 23:40:54 [DEBUG   ] Got command RPT from MCS: ref #839868
2018-12-14 23:40:54 [DEBUG   ] summary = ERROR
2018-12-14 23:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839868  13 58466 85254741 A  ERRORERROR'
2018-12-14 23:40:54 [DEBUG   ] Got command RPT from MCS: ref #839869
2018-12-14 23:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839869  77 58466 85254742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:40:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 23:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 23:41:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:41:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:41:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:41:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:41:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:41:04 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-14 23:41:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-14 23:41:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 23:41:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:42:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:42:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:42:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:42:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:42:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:42:04 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-12-14 23:42:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:42:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-14 23:42:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 23:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:43:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:43:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:43:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:43:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:43:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:43:04 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-12-14 23:43:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 23:43:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 23:43:55 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-14 23:44:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:44:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:44:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:44:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:44:04 [WARNING ] (13, 1, 'bot')
2018-12-14 23:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:44:04 [DEBUG   ] Finished updating board flags in 1.365 seconds
2018-12-14 23:44:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 23:44:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 23:44:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 23:45:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:45:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:45:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:45:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:45:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:45:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:45:05 [DEBUG   ] Finished updating board flags in 2.052 seconds
2018-12-14 23:45:06 [DEBUG   ] Got command RPT from MCS: ref #839893
2018-12-14 23:45:06 [DEBUG   ] summary = ERROR
2018-12-14 23:45:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839893  13 58466 85506845 A  ERRORERROR'
2018-12-14 23:45:07 [DEBUG   ] Got command RPT from MCS: ref #839894
2018-12-14 23:45:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839894  77 58466 85507037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:45:07 [DEBUG   ] Got command RPT from MCS: ref #839895
2018-12-14 23:45:07 [DEBUG   ] summary = ERROR
2018-12-14 23:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839895  13 58466 85507241 A  ERRORERROR'
2018-12-14 23:45:07 [DEBUG   ] Got command RPT from MCS: ref #839896
2018-12-14 23:45:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839896  77 58466 85507445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:45:07 [DEBUG   ] Got command RPT from MCS: ref #839897
2018-12-14 23:45:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839897  12 58466 85507649 A  ERRORB•™š'
2018-12-14 23:45:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-14 23:45:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-14 23:45:54 [DEBUG   ] Got command RPT from MCS: ref #839898
2018-12-14 23:45:54 [DEBUG   ] summary = ERROR
2018-12-14 23:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839898  13 58466 85554733 A  ERRORERROR'
2018-12-14 23:45:54 [DEBUG   ] Got command RPT from MCS: ref #839899
2018-12-14 23:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839899  77 58466 85554734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:45:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-14 23:46:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:46:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:46:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:46:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:46:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:46:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:46:05 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-12-14 23:46:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-14 23:46:36 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 23:46:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-14 23:47:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:47:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:47:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:47:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:47:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:47:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:47:05 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-14 23:47:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-14 23:47:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-14 23:47:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-14 23:48:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:48:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:48:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:48:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:48:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:48:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:48:05 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-12-14 23:48:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-14 23:48:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 23:48:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-14 23:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:49:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:49:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:49:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:49:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:49:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:49:05 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-14 23:49:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 23:49:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-14 23:49:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-14 23:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:50:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:50:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:50:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:50:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:50:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:50:05 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-12-14 23:50:06 [DEBUG   ] Got command RPT from MCS: ref #839921
2018-12-14 23:50:06 [DEBUG   ] summary = ERROR
2018-12-14 23:50:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839921  13 58466 85806925 A  ERRORERROR'
2018-12-14 23:50:07 [DEBUG   ] Got command RPT from MCS: ref #839922
2018-12-14 23:50:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839922  77 58466 85807117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:50:07 [DEBUG   ] Got command RPT from MCS: ref #839923
2018-12-14 23:50:07 [DEBUG   ] summary = ERROR
2018-12-14 23:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839923  13 58466 85807321 A  ERRORERROR'
2018-12-14 23:50:07 [DEBUG   ] Got command RPT from MCS: ref #839925
2018-12-14 23:50:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839925  77 58466 85807525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:50:07 [DEBUG   ] Got command RPT from MCS: ref #839927
2018-12-14 23:50:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839927  12 58466 85807729 A  ERRORB”™š'
2018-12-14 23:50:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-14 23:50:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-14 23:50:54 [DEBUG   ] Got command RPT from MCS: ref #839935
2018-12-14 23:50:54 [DEBUG   ] summary = ERROR
2018-12-14 23:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839935  13 58466 85854733 A  ERRORERROR'
2018-12-14 23:50:54 [DEBUG   ] Got command RPT from MCS: ref #839936
2018-12-14 23:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839936  77 58466 85854734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:50:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 23:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:51:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:51:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:51:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:51:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:51:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:51:05 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-14 23:51:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 23:51:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 23:51:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 23:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:52:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 23:52:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:52:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:52:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:52:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:52:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:52:05 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-12-14 23:52:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 23:52:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 23:52:56 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-14 23:53:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:53:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:53:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:53:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:53:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:53:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:53:05 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-12-14 23:53:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 23:53:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-14 23:53:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 23:54:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:54:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:54:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:54:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:54:05 [WARNING ] (13, 1, 'bot')
2018-12-14 23:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:54:05 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-12-14 23:54:17 [DEBUG   ] Finished updating ant stats in 1.183 seconds
2018-12-14 23:54:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:54:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:55:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-14 23:55:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:55:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:55:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:55:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:55:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:55:06 [DEBUG   ] Finished updating board flags in 2.262 seconds
2018-12-14 23:55:07 [DEBUG   ] Got command RPT from MCS: ref #839956
2018-12-14 23:55:07 [DEBUG   ] summary = ERROR
2018-12-14 23:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839956  13 58466 86107001 A  ERRORERROR'
2018-12-14 23:55:07 [DEBUG   ] Got command RPT from MCS: ref #839957
2018-12-14 23:55:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839957  77 58466 86107205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:55:07 [DEBUG   ] Got command RPT from MCS: ref #839958
2018-12-14 23:55:07 [DEBUG   ] summary = ERROR
2018-12-14 23:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839958  13 58466 86107397 A  ERRORERROR'
2018-12-14 23:55:07 [DEBUG   ] Got command RPT from MCS: ref #839959
2018-12-14 23:55:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839959  77 58466 86107601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:55:07 [DEBUG   ] Got command RPT from MCS: ref #839960
2018-12-14 23:55:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-14 23:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839960  12 58466 86107805 A  ERRORB•™š'
2018-12-14 23:55:17 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-12-14 23:55:37 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-12-14 23:55:54 [DEBUG   ] Got command RPT from MCS: ref #839961
2018-12-14 23:55:54 [DEBUG   ] summary = ERROR
2018-12-14 23:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839961  13 58466 86154737 A  ERRORERROR'
2018-12-14 23:55:54 [DEBUG   ] Got command RPT from MCS: ref #839962
2018-12-14 23:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-14 23:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839962  77 58466 86154738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-14 23:55:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-14 23:56:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:56:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:56:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:56:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:56:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:56:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:56:06 [DEBUG   ] Finished updating board flags in 2.135 seconds
2018-12-14 23:56:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-14 23:56:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-14 23:56:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-14 23:57:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:57:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:57:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:57:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:57:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:57:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:57:06 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-12-14 23:57:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-14 23:57:38 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-14 23:57:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-14 23:58:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:58:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:58:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:58:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:58:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:58:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:58:06 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-12-14 23:58:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:58:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-14 23:58:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-14 23:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-14 23:59:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-14 23:59:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:59:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:59:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:59:06 [WARNING ] (13, 1, 'bot')
2018-12-14 23:59:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-14 23:59:06 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-14 23:59:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-14 23:59:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-14 23:59:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 00:00:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:00:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:00:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:00:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:00:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:00:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:00:06 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-12-15 00:00:07 [DEBUG   ] Got command RPT from MCS: ref #839988
2018-12-15 00:00:07 [DEBUG   ] summary = ERROR
2018-12-15 00:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839988  13 58467     7081 A  ERRORERROR'
2018-12-15 00:00:07 [DEBUG   ] Got command RPT from MCS: ref #839989
2018-12-15 00:00:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839989  77 58467     7285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:00:07 [DEBUG   ] Got command RPT from MCS: ref #839990
2018-12-15 00:00:07 [DEBUG   ] summary = ERROR
2018-12-15 00:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839990  13 58467     7477 A  ERRORERROR'
2018-12-15 00:00:07 [DEBUG   ] Got command RPT from MCS: ref #839992
2018-12-15 00:00:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839992  77 58467     7681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:00:07 [DEBUG   ] Got command RPT from MCS: ref #839993
2018-12-15 00:00:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839993  12 58467     7885 A  ERRORB—™š'
2018-12-15 00:00:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 00:00:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 00:00:54 [DEBUG   ] Got command RPT from MCS: ref #839998
2018-12-15 00:00:54 [DEBUG   ] summary = ERROR
2018-12-15 00:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839998  13 58467    54733 A  ERRORERROR'
2018-12-15 00:00:54 [DEBUG   ] Got command RPT from MCS: ref #839999
2018-12-15 00:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   839999  77 58467    54734 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:00:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 00:01:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 00:01:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:01:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:01:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:01:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:01:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:01:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:01:06 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-12-15 00:01:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 00:01:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 00:01:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 00:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 00:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:02:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:02:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:02:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:02:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:02:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:02:06 [DEBUG   ] Finished updating board flags in 1.686 seconds
2018-12-15 00:02:19 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 00:02:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 00:02:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 00:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 00:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 00:03:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:03:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:03:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:03:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:03:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:03:06 [DEBUG   ] Finished updating board flags in 1.523 seconds
2018-12-15 00:03:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 00:03:39 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2018-12-15 00:03:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 00:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 00:04:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:04:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:04:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:04:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:04:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:04:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:04:07 [DEBUG   ] Finished updating board flags in 2.416 seconds
2018-12-15 00:04:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 00:04:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 00:04:59 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-15 00:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:05:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:05:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:05:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:05:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:05:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:05:06 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-12-15 00:05:07 [DEBUG   ] Got command RPT from MCS: ref #840019
2018-12-15 00:05:07 [DEBUG   ] summary = ERROR
2018-12-15 00:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840019  13 58467   307165 A  ERRORERROR'
2018-12-15 00:05:07 [DEBUG   ] Got command RPT from MCS: ref #840020
2018-12-15 00:05:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840020  77 58467   307369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:05:07 [DEBUG   ] Got command RPT from MCS: ref #840021
2018-12-15 00:05:07 [DEBUG   ] summary = ERROR
2018-12-15 00:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840021  13 58467   307561 A  ERRORERROR'
2018-12-15 00:05:07 [DEBUG   ] Got command RPT from MCS: ref #840022
2018-12-15 00:05:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840022  77 58467   307765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:05:07 [DEBUG   ] Got command RPT from MCS: ref #840023
2018-12-15 00:05:07 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:05:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840023  12 58467   307970 A  ERRORB–™š'
2018-12-15 00:05:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 00:05:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 00:05:54 [DEBUG   ] Got command RPT from MCS: ref #840028
2018-12-15 00:05:54 [DEBUG   ] summary = ERROR
2018-12-15 00:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840028  13 58467   354745 A  ERRORERROR'
2018-12-15 00:05:54 [DEBUG   ] Got command RPT from MCS: ref #840029
2018-12-15 00:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840029  77 58467   354746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:05:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 00:06:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:06:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:06:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:06:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:06:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:06:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:06:07 [DEBUG   ] Finished updating board flags in 2.209 seconds
2018-12-15 00:06:19 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-15 00:06:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 00:06:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 00:07:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:07:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:07:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:07:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:07:06 [WARNING ] (13, 1, 'bot')
2018-12-15 00:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:07:06 [DEBUG   ] Finished updating board flags in 1.314 seconds
2018-12-15 00:07:20 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 00:07:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-15 00:07:59 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-12-15 00:08:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:08:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 00:08:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:08:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:08:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:08:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:08:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:08:07 [DEBUG   ] Finished updating board flags in 2.094 seconds
2018-12-15 00:08:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 00:08:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 00:09:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 00:09:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:09:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:09:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:09:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:09:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:09:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:09:07 [DEBUG   ] Finished updating board flags in 1.995 seconds
2018-12-15 00:09:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 00:09:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 00:10:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 00:10:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:10:07 [DEBUG   ] Got command RPT from MCS: ref #840051
2018-12-15 00:10:07 [DEBUG   ] summary = ERROR
2018-12-15 00:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840051  13 58467   607246 A  ERRORERROR'
2018-12-15 00:10:07 [DEBUG   ] Got command RPT from MCS: ref #840052
2018-12-15 00:10:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840052  77 58467   607449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:10:07 [DEBUG   ] Got command RPT from MCS: ref #840053
2018-12-15 00:10:07 [DEBUG   ] summary = ERROR
2018-12-15 00:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840053  13 58467   607641 A  ERRORERROR'
2018-12-15 00:10:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:10:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:10:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:10:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:10:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:10:07 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-12-15 00:10:07 [DEBUG   ] Got command RPT from MCS: ref #840055
2018-12-15 00:10:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:10:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840055  77 58467   607845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:10:08 [DEBUG   ] Got command RPT from MCS: ref #840056
2018-12-15 00:10:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:10:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840056  12 58467   608049 A  ERRORB•™š'
2018-12-15 00:10:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 00:10:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 00:10:54 [DEBUG   ] Got command RPT from MCS: ref #840061
2018-12-15 00:10:54 [DEBUG   ] summary = ERROR
2018-12-15 00:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840061  13 58467   654745 A  ERRORERROR'
2018-12-15 00:10:54 [DEBUG   ] Got command RPT from MCS: ref #840062
2018-12-15 00:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840062  77 58467   654746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:11:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 00:11:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 00:11:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:11:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:11:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:11:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:11:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:11:07 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-12-15 00:11:20 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-15 00:11:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 00:12:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 00:12:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:12:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:12:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:12:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:12:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:12:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:12:07 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-15 00:12:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 00:12:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 00:13:00 [DEBUG   ] Finished updating ant stats in 0.451 seconds
2018-12-15 00:13:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:13:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:13:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:13:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:13:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:13:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:13:07 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-12-15 00:13:21 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-15 00:13:41 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 00:14:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 00:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:14:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:14:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:14:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:14:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:14:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:14:07 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-12-15 00:14:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 00:14:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 00:15:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 00:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:15:07 [DEBUG   ] Got command RPT from MCS: ref #840086
2018-12-15 00:15:07 [DEBUG   ] summary = ERROR
2018-12-15 00:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840086  13 58467   907326 A  ERRORERROR'
2018-12-15 00:15:07 [DEBUG   ] Got command RPT from MCS: ref #840087
2018-12-15 00:15:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840087  77 58467   907518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:15:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:15:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:15:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:15:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:15:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:15:07 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-12-15 00:15:07 [DEBUG   ] Got command RPT from MCS: ref #840088
2018-12-15 00:15:07 [DEBUG   ] summary = ERROR
2018-12-15 00:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840088  13 58467   907721 A  ERRORERROR'
2018-12-15 00:15:07 [DEBUG   ] Got command RPT from MCS: ref #840089
2018-12-15 00:15:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840089  77 58467   907925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:15:08 [DEBUG   ] Got command RPT from MCS: ref #840090
2018-12-15 00:15:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840090  12 58467   908130 A  ERRORB•™š'
2018-12-15 00:15:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 00:15:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 00:15:54 [DEBUG   ] Got command RPT from MCS: ref #840091
2018-12-15 00:15:54 [DEBUG   ] summary = ERROR
2018-12-15 00:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840091  13 58467   954737 A  ERRORERROR'
2018-12-15 00:15:54 [DEBUG   ] Got command RPT from MCS: ref #840092
2018-12-15 00:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840092  77 58467   954738 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:16:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-15 00:16:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:16:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 00:16:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:16:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:16:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:16:07 [WARNING ] (13, 1, 'bot')
2018-12-15 00:16:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:16:07 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-12-15 00:16:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 00:16:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 00:17:01 [DEBUG   ] Finished updating ant stats in 0.673 seconds
2018-12-15 00:17:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:17:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:17:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:17:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:17:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:17:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:17:08 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-12-15 00:17:21 [DEBUG   ] Finished updating ant stats in 0.530 seconds
2018-12-15 00:17:42 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 00:18:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 00:18:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:18:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:18:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:18:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:18:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:18:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:18:08 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-12-15 00:18:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 00:18:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 00:19:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 00:19:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:19:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 00:19:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:19:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:19:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:19:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:19:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:19:08 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-15 00:19:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 00:19:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 00:20:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 00:20:07 [DEBUG   ] Got command RPT from MCS: ref #840114
2018-12-15 00:20:07 [DEBUG   ] summary = ERROR
2018-12-15 00:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840114  13 58467  1207397 A  ERRORERROR'
2018-12-15 00:20:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:20:07 [DEBUG   ] Got command RPT from MCS: ref #840115
2018-12-15 00:20:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840115  77 58467  1207606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:20:07 [DEBUG   ] Got command RPT from MCS: ref #840116
2018-12-15 00:20:07 [DEBUG   ] summary = ERROR
2018-12-15 00:20:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840116  13 58467  1207809 A  ERRORERROR'
2018-12-15 00:20:08 [DEBUG   ] Got command RPT from MCS: ref #840118
2018-12-15 00:20:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840118  77 58467  1208001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:20:08 [DEBUG   ] Got command RPT from MCS: ref #840119
2018-12-15 00:20:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840119  12 58467  1208205 A  ERRORB�ÌÍ'
2018-12-15 00:20:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:20:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:20:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:20:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:20:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:20:08 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-12-15 00:20:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 00:20:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 00:20:54 [DEBUG   ] Got command RPT from MCS: ref #840128
2018-12-15 00:20:54 [DEBUG   ] summary = ERROR
2018-12-15 00:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840128  13 58467  1254741 A  ERRORERROR'
2018-12-15 00:20:54 [DEBUG   ] Got command RPT from MCS: ref #840129
2018-12-15 00:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840129  77 58467  1254742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:21:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 00:21:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:21:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:21:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:21:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:21:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:21:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:21:08 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-15 00:21:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 00:21:42 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 00:22:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 00:22:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:22:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:22:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:22:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:22:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:22:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:22:08 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-12-15 00:22:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 00:22:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 00:23:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 00:23:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:23:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:23:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:23:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:23:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:23:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:23:08 [DEBUG   ] Finished updating board flags in 1.642 seconds
2018-12-15 00:23:22 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-12-15 00:23:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 00:24:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 00:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 00:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:24:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:24:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:24:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:24:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:24:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:24:08 [DEBUG   ] Finished updating board flags in 1.558 seconds
2018-12-15 00:24:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 00:24:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 00:25:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 00:25:07 [DEBUG   ] Got command RPT from MCS: ref #840149
2018-12-15 00:25:07 [DEBUG   ] summary = ERROR
2018-12-15 00:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840149  13 58467  1507481 A  ERRORERROR'
2018-12-15 00:25:07 [DEBUG   ] Got command RPT from MCS: ref #840150
2018-12-15 00:25:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840150  77 58467  1507686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:25:07 [DEBUG   ] Got command RPT from MCS: ref #840151
2018-12-15 00:25:07 [DEBUG   ] summary = ERROR
2018-12-15 00:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840151  13 58467  1507890 A  ERRORERROR'
2018-12-15 00:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:25:08 [DEBUG   ] Got command RPT from MCS: ref #840152
2018-12-15 00:25:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840152  77 58467  1508082 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:25:08 [DEBUG   ] Got command RPT from MCS: ref #840153
2018-12-15 00:25:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840153  12 58467  1508286 A  ERRORB‘™š'
2018-12-15 00:25:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:25:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:25:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:25:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:25:08 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-12-15 00:25:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 00:25:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 00:25:54 [DEBUG   ] Got command RPT from MCS: ref #840154
2018-12-15 00:25:54 [DEBUG   ] summary = ERROR
2018-12-15 00:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840154  13 58467  1554741 A  ERRORERROR'
2018-12-15 00:25:54 [DEBUG   ] Got command RPT from MCS: ref #840155
2018-12-15 00:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840155  77 58467  1554742 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:26:03 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-15 00:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 00:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:26:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:26:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:26:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:26:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:26:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:26:08 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-12-15 00:26:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 00:26:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 00:27:03 [DEBUG   ] Finished updating ant stats in 0.786 seconds
2018-12-15 00:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:27:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:27:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:27:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:27:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:27:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:27:08 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-12-15 00:27:23 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-15 00:27:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 00:28:04 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-15 00:28:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:28:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:28:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:28:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:28:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:28:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:28:08 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-15 00:28:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 00:28:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 00:29:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 00:29:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:29:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:29:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:29:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:29:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:29:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:29:08 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-15 00:29:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 00:29:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 00:30:04 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-12-15 00:30:07 [DEBUG   ] Got command RPT from MCS: ref #840181
2018-12-15 00:30:07 [DEBUG   ] summary = ERROR
2018-12-15 00:30:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840181  13 58467  1807570 A  ERRORERROR'
2018-12-15 00:30:07 [DEBUG   ] Got command RPT from MCS: ref #840182
2018-12-15 00:30:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:30:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840182  77 58467  1807761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:30:07 [DEBUG   ] Got command RPT from MCS: ref #840183
2018-12-15 00:30:07 [DEBUG   ] summary = ERROR
2018-12-15 00:30:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840183  13 58467  1807965 A  ERRORERROR'
2018-12-15 00:30:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:30:08 [DEBUG   ] Got command RPT from MCS: ref #840185
2018-12-15 00:30:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840185  77 58467  1808175 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:30:08 [DEBUG   ] Got command RPT from MCS: ref #840186
2018-12-15 00:30:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840186  12 58467  1808365 A  ERRORB‘™š'
2018-12-15 00:30:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:30:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:30:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:30:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:30:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:30:08 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-12-15 00:30:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 00:30:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 00:30:54 [DEBUG   ] Got command RPT from MCS: ref #840191
2018-12-15 00:30:54 [DEBUG   ] summary = ERROR
2018-12-15 00:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840191  13 58467  1854749 A  ERRORERROR'
2018-12-15 00:30:54 [DEBUG   ] Got command RPT from MCS: ref #840192
2018-12-15 00:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840192  77 58467  1854750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:31:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 00:31:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:31:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:31:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:31:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:31:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:31:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:31:08 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-12-15 00:31:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 00:31:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 00:32:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 00:32:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:32:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:32:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:32:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:32:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:32:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:32:08 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-12-15 00:32:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 00:32:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 00:33:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 00:33:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:33:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:33:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:33:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:33:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:33:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:33:08 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-15 00:33:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 00:33:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 00:34:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 00:34:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:34:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:34:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:34:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:34:08 [WARNING ] (13, 1, 'bot')
2018-12-15 00:34:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:34:08 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-12-15 00:34:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 00:34:45 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-15 00:35:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 00:35:07 [DEBUG   ] Got command RPT from MCS: ref #840212
2018-12-15 00:35:07 [DEBUG   ] summary = ERROR
2018-12-15 00:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840212  13 58467  2107649 A  ERRORERROR'
2018-12-15 00:35:07 [DEBUG   ] Got command RPT from MCS: ref #840213
2018-12-15 00:35:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840213  77 58467  2107841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:35:08 [DEBUG   ] Got command RPT from MCS: ref #840214
2018-12-15 00:35:08 [DEBUG   ] summary = ERROR
2018-12-15 00:35:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840214  13 58467  2108046 A  ERRORERROR'
2018-12-15 00:35:08 [DEBUG   ] Got command RPT from MCS: ref #840215
2018-12-15 00:35:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:35:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840215  77 58467  2108246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:35:08 [DEBUG   ] Got command RPT from MCS: ref #840216
2018-12-15 00:35:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:35:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840216  12 58467  2108449 A  ERRORB�'
2018-12-15 00:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:35:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 00:35:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:35:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:35:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:35:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:35:09 [DEBUG   ] Finished updating board flags in 2.239 seconds
2018-12-15 00:35:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 00:35:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 00:35:54 [DEBUG   ] Got command RPT from MCS: ref #840221
2018-12-15 00:35:54 [DEBUG   ] summary = ERROR
2018-12-15 00:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840221  13 58467  2154749 A  ERRORERROR'
2018-12-15 00:35:54 [DEBUG   ] Got command RPT from MCS: ref #840222
2018-12-15 00:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840222  77 58467  2154750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:36:00 [DEBUG   ] Got command TBN from MCS: ref #840238
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-12-15 00:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   840238   8 58467  2160862 A  ERROR'
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1544834162']
2018-12-15 00:36:00 [DEBUG   ] spawn_process: at 2018-12-15 00:36:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1544834162']
2018-12-15 00:36:00 [INFO    ] Finished spawning TBN in 0.054 s
2018-12-15 00:36:05 [DEBUG   ] Finished updating ant stats in 0.733 seconds
2018-12-15 00:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:36:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 00:36:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:36:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:36:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:36:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:36:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:36:09 [DEBUG   ] Finished updating board flags in 2.159 seconds
2018-12-15 00:36:25 [DEBUG   ] Finished updating ant stats in 0.669 seconds
2018-12-15 00:36:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 00:37:06 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-15 00:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:37:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:37:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:37:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:37:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:37:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:37:09 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-12-15 00:37:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 00:37:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 00:38:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 00:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 00:38:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:38:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:38:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:38:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:38:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:38:09 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-12-15 00:38:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 00:38:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-15 00:39:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 00:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:39:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:39:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:39:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:39:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:39:09 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-15 00:39:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 00:39:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 00:40:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 00:40:07 [DEBUG   ] Got command RPT from MCS: ref #840245
2018-12-15 00:40:07 [DEBUG   ] summary = ERROR
2018-12-15 00:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840245  13 58467  2407729 A  ERRORERROR'
2018-12-15 00:40:07 [DEBUG   ] Got command RPT from MCS: ref #840246
2018-12-15 00:40:07 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:40:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840246  77 58467  2407921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:40:08 [DEBUG   ] Got command RPT from MCS: ref #840247
2018-12-15 00:40:08 [DEBUG   ] summary = ERROR
2018-12-15 00:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840247  13 58467  2408126 A  ERRORERROR'
2018-12-15 00:40:08 [DEBUG   ] Got command RPT from MCS: ref #840249
2018-12-15 00:40:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840249  77 58467  2408322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:40:08 [DEBUG   ] Got command RPT from MCS: ref #840250
2018-12-15 00:40:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840250  12 58467  2408529 A  ERRORBŠÌÍ'
2018-12-15 00:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:40:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:40:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:40:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:40:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:40:09 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-12-15 00:40:26 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-12-15 00:40:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 00:40:54 [DEBUG   ] Got command RPT from MCS: ref #840255
2018-12-15 00:40:54 [DEBUG   ] summary = ERROR
2018-12-15 00:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840255  13 58467  2454749 A  ERRORERROR'
2018-12-15 00:40:54 [DEBUG   ] Got command RPT from MCS: ref #840256
2018-12-15 00:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840256  77 58467  2454750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:41:07 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 00:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 00:41:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:41:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:41:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:41:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:41:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:41:09 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-15 00:41:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 00:41:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 00:42:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 00:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:42:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:42:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:42:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:42:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:42:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:42:09 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-12-15 00:42:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 00:42:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 00:43:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 00:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:43:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:43:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:43:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:43:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:43:09 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-12-15 00:43:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-15 00:43:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 00:44:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 00:44:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:44:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:44:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:44:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:44:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:44:09 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-12-15 00:44:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 00:44:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 00:45:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 00:45:07 [DEBUG   ] Got command RPT from MCS: ref #840280
2018-12-15 00:45:07 [DEBUG   ] summary = ERROR
2018-12-15 00:45:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840280  13 58467  2707805 A  ERRORERROR'
2018-12-15 00:45:08 [DEBUG   ] Got command RPT from MCS: ref #840281
2018-12-15 00:45:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840281  77 58467  2708009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:45:08 [DEBUG   ] Got command RPT from MCS: ref #840282
2018-12-15 00:45:08 [DEBUG   ] summary = ERROR
2018-12-15 00:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840282  13 58467  2708201 A  ERRORERROR'
2018-12-15 00:45:08 [DEBUG   ] Got command RPT from MCS: ref #840283
2018-12-15 00:45:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840283  77 58467  2708405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:45:08 [DEBUG   ] Got command RPT from MCS: ref #840284
2018-12-15 00:45:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840284  12 58467  2708610 A  ERRORB~'
2018-12-15 00:45:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:45:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:45:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:45:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:45:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:45:09 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-12-15 00:45:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 00:45:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 00:45:54 [DEBUG   ] Got command RPT from MCS: ref #840285
2018-12-15 00:45:54 [DEBUG   ] summary = ERROR
2018-12-15 00:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840285  13 58467  2754753 A  ERRORERROR'
2018-12-15 00:45:54 [DEBUG   ] Got command RPT from MCS: ref #840286
2018-12-15 00:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840286  77 58467  2754754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:46:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 00:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:46:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:46:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:46:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:46:09 [WARNING ] (13, 1, 'bot')
2018-12-15 00:46:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:46:09 [DEBUG   ] Finished updating board flags in 1.334 seconds
2018-12-15 00:46:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 00:46:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 00:47:08 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 00:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:47:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:47:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:47:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:47:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:47:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:47:10 [DEBUG   ] Finished updating board flags in 2.079 seconds
2018-12-15 00:47:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 00:47:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 00:48:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 00:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 00:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:48:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:48:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:48:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:48:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:48:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:48:10 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-12-15 00:48:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 00:48:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 00:49:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 00:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:49:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 00:49:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:49:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:49:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:49:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:49:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:49:10 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-15 00:49:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 00:49:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 00:50:07 [DEBUG   ] Got command RPT from MCS: ref #840308
2018-12-15 00:50:07 [DEBUG   ] summary = ERROR
2018-12-15 00:50:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840308  13 58467  3007886 A  ERRORERROR'
2018-12-15 00:50:08 [DEBUG   ] Got command RPT from MCS: ref #840309
2018-12-15 00:50:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840309  77 58467  3008089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:50:08 [DEBUG   ] Got command RPT from MCS: ref #840310
2018-12-15 00:50:08 [DEBUG   ] summary = ERROR
2018-12-15 00:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840310  13 58467  3008281 A  ERRORERROR'
2018-12-15 00:50:08 [DEBUG   ] Finished updating ant stats in 0.587 seconds
2018-12-15 00:50:08 [DEBUG   ] Got command RPT from MCS: ref #840312
2018-12-15 00:50:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840312  77 58467  3008485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:50:08 [DEBUG   ] Got command RPT from MCS: ref #840313
2018-12-15 00:50:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840313  12 58467  3008689 A  ERRORB•™š'
2018-12-15 00:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:50:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:50:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:50:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:50:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:50:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:50:10 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-15 00:50:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 00:50:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 00:50:54 [DEBUG   ] Got command RPT from MCS: ref #840322
2018-12-15 00:50:54 [DEBUG   ] summary = ERROR
2018-12-15 00:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840322  13 58467  3054745 A  ERRORERROR'
2018-12-15 00:50:54 [DEBUG   ] Got command RPT from MCS: ref #840323
2018-12-15 00:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840323  77 58467  3054746 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:51:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 00:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:51:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:51:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:51:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:51:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:51:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:51:10 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-12-15 00:51:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 00:51:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 00:52:09 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2018-12-15 00:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:52:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:52:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:52:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:52:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:52:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:52:10 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-12-15 00:52:29 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-12-15 00:52:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 00:53:09 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2018-12-15 00:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:53:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:53:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:53:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:53:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:53:10 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-12-15 00:53:29 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2018-12-15 00:53:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 00:54:09 [DEBUG   ] Finished updating ant stats in 0.635 seconds
2018-12-15 00:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:54:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:54:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:54:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:54:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:54:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:54:10 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-12-15 00:54:29 [DEBUG   ] Finished updating ant stats in 0.571 seconds
2018-12-15 00:54:50 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 00:55:07 [DEBUG   ] Got command RPT from MCS: ref #840343
2018-12-15 00:55:07 [DEBUG   ] summary = ERROR
2018-12-15 00:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840343  13 58467  3307961 A  ERRORERROR'
2018-12-15 00:55:08 [DEBUG   ] Got command RPT from MCS: ref #840344
2018-12-15 00:55:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840344  77 58467  3308165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:55:08 [DEBUG   ] Got command RPT from MCS: ref #840345
2018-12-15 00:55:08 [DEBUG   ] summary = ERROR
2018-12-15 00:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840345  13 58467  3308369 A  ERRORERROR'
2018-12-15 00:55:08 [DEBUG   ] Got command RPT from MCS: ref #840346
2018-12-15 00:55:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840346  77 58467  3308561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:55:08 [DEBUG   ] Got command RPT from MCS: ref #840347
2018-12-15 00:55:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 00:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840347  12 58467  3308765 A  ERRORB—™š'
2018-12-15 00:55:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:55:10 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2018-12-15 00:55:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:55:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:55:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:55:10 [WARNING ] (13, 1, 'bot')
2018-12-15 00:55:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:55:10 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-12-15 00:55:30 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2018-12-15 00:55:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 00:55:54 [DEBUG   ] Got command RPT from MCS: ref #840348
2018-12-15 00:55:54 [DEBUG   ] summary = ERROR
2018-12-15 00:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840348  13 58467  3354753 A  ERRORERROR'
2018-12-15 00:55:54 [DEBUG   ] Got command RPT from MCS: ref #840349
2018-12-15 00:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 00:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840349  77 58467  3354754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 00:56:10 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2018-12-15 00:56:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:56:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:56:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:56:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:56:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:56:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:56:11 [DEBUG   ] Finished updating board flags in 2.197 seconds
2018-12-15 00:56:30 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-12-15 00:56:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 00:57:10 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-12-15 00:57:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:57:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:57:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:57:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:57:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:57:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:57:11 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-12-15 00:57:30 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2018-12-15 00:57:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 00:58:10 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-12-15 00:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:58:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:58:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:58:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:58:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:58:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:58:11 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-15 00:58:30 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2018-12-15 00:58:51 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-15 00:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 00:59:11 [DEBUG   ] Finished updating ant stats in 1.253 seconds
2018-12-15 00:59:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:59:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:59:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:59:11 [WARNING ] (13, 1, 'bot')
2018-12-15 00:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 00:59:11 [DEBUG   ] Finished updating board flags in 1.852 seconds
2018-12-15 00:59:31 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2018-12-15 00:59:51 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-15 01:00:08 [DEBUG   ] Got command RPT from MCS: ref #840375
2018-12-15 01:00:08 [DEBUG   ] summary = ERROR
2018-12-15 01:00:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840375  13 58467  3608049 A  ERRORERROR'
2018-12-15 01:00:08 [DEBUG   ] Got command RPT from MCS: ref #840376
2018-12-15 01:00:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:00:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840376  77 58467  3608241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:00:08 [DEBUG   ] Got command RPT from MCS: ref #840377
2018-12-15 01:00:08 [DEBUG   ] summary = ERROR
2018-12-15 01:00:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840377  13 58467  3608445 A  ERRORERROR'
2018-12-15 01:00:08 [DEBUG   ] Got command RPT from MCS: ref #840379
2018-12-15 01:00:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:00:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840379  77 58467  3608649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:00:08 [DEBUG   ] Got command RPT from MCS: ref #840381
2018-12-15 01:00:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:00:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840381  12 58467  3608841 A  ERRORB–™š'
2018-12-15 01:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:00:11 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2018-12-15 01:00:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 01:00:11 [WARNING ] (13, 1, 'bot')
2018-12-15 01:00:11 [WARNING ] (13, 1, 'bot')
2018-12-15 01:00:11 [WARNING ] (13, 1, 'bot')
2018-12-15 01:00:11 [WARNING ] (13, 1, 'bot')
2018-12-15 01:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:00:11 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-15 01:00:31 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-12-15 01:00:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 01:00:54 [DEBUG   ] Got command RPT from MCS: ref #840385
2018-12-15 01:00:54 [DEBUG   ] summary = ERROR
2018-12-15 01:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840385  13 58467  3654749 A  ERRORERROR'
2018-12-15 01:00:54 [DEBUG   ] Got command RPT from MCS: ref #840386
2018-12-15 01:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840386  77 58467  3654750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:01:11 [WARNING ] (13, 1, 'bot')
2018-12-15 01:01:11 [WARNING ] (13, 1, 'bot')
2018-12-15 01:01:11 [WARNING ] (13, 1, 'bot')
2018-12-15 01:01:11 [WARNING ] (13, 1, 'bot')
2018-12-15 01:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:01:11 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-12-15 01:01:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 01:01:32 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 01:01:52 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 01:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:02:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 01:02:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 01:02:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:02:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:02:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:02:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:02:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:02:12 [DEBUG   ] Finished updating board flags in 2.342 seconds
2018-12-15 01:02:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 01:02:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 01:03:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:03:12 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2018-12-15 01:03:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 01:03:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:03:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:03:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:03:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:03:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:03:12 [DEBUG   ] Finished updating board flags in 2.251 seconds
2018-12-15 01:03:32 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-12-15 01:03:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 01:04:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:04:12 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2018-12-15 01:04:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:04:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:04:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:04:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:04:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:04:12 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-12-15 01:04:32 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-12-15 01:04:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 01:05:08 [DEBUG   ] Got command RPT from MCS: ref #840406
2018-12-15 01:05:08 [DEBUG   ] summary = ERROR
2018-12-15 01:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840406  13 58467  3908125 A  ERRORERROR'
2018-12-15 01:05:08 [DEBUG   ] Got command RPT from MCS: ref #840407
2018-12-15 01:05:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840407  77 58467  3908329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:05:08 [DEBUG   ] Got command RPT from MCS: ref #840408
2018-12-15 01:05:08 [DEBUG   ] summary = ERROR
2018-12-15 01:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840408  13 58467  3908522 A  ERRORERROR'
2018-12-15 01:05:08 [DEBUG   ] Got command RPT from MCS: ref #840409
2018-12-15 01:05:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840409  77 58467  3908725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:05:08 [DEBUG   ] Got command RPT from MCS: ref #840410
2018-12-15 01:05:08 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:05:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840410  12 58467  3908929 A  ERRORB•™š'
2018-12-15 01:05:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:05:12 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2018-12-15 01:05:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:05:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:05:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:05:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:05:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:05:12 [DEBUG   ] Finished updating board flags in 2.188 seconds
2018-12-15 01:05:32 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2018-12-15 01:05:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 01:05:54 [DEBUG   ] Got command RPT from MCS: ref #840415
2018-12-15 01:05:54 [DEBUG   ] summary = ERROR
2018-12-15 01:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840415  13 58467  3954749 A  ERRORERROR'
2018-12-15 01:05:54 [DEBUG   ] Got command RPT from MCS: ref #840416
2018-12-15 01:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840416  77 58467  3954750 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:06:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:06:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 01:06:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:06:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:06:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:06:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:06:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:06:12 [DEBUG   ] Finished updating board flags in 2.036 seconds
2018-12-15 01:06:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 01:06:33 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 01:06:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 01:07:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:07:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 01:07:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:07:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:07:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:07:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:07:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:07:13 [DEBUG   ] Finished updating board flags in 2.871 seconds
2018-12-15 01:07:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 01:07:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 01:08:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:08:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:08:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:08:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:08:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:08:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:08:12 [DEBUG   ] Finished updating board flags in 1.906 seconds
2018-12-15 01:08:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 01:08:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 01:08:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 01:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:09:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:09:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:09:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:09:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:09:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:09:12 [DEBUG   ] Finished updating board flags in 1.760 seconds
2018-12-15 01:09:13 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-15 01:09:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 01:09:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 01:10:08 [DEBUG   ] Got command RPT from MCS: ref #840438
2018-12-15 01:10:08 [DEBUG   ] summary = ERROR
2018-12-15 01:10:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840438  13 58467  4208205 A  ERRORERROR'
2018-12-15 01:10:08 [DEBUG   ] Got command RPT from MCS: ref #840439
2018-12-15 01:10:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:10:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840439  77 58467  4208409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:10:08 [DEBUG   ] Got command RPT from MCS: ref #840440
2018-12-15 01:10:08 [DEBUG   ] summary = ERROR
2018-12-15 01:10:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840440  13 58467  4208601 A  ERRORERROR'
2018-12-15 01:10:08 [DEBUG   ] Got command RPT from MCS: ref #840442
2018-12-15 01:10:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:10:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840442  77 58467  4208805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:10:09 [DEBUG   ] Got command RPT from MCS: ref #840443
2018-12-15 01:10:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:10:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840443  12 58467  4209009 A  ERRORB”™š'
2018-12-15 01:10:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:10:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:10:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:10:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:10:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:10:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:10:12 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-12-15 01:10:14 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-15 01:10:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 01:10:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 01:10:54 [DEBUG   ] Got command RPT from MCS: ref #840448
2018-12-15 01:10:54 [DEBUG   ] summary = ERROR
2018-12-15 01:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840448  13 58467  4254757 A  ERRORERROR'
2018-12-15 01:10:54 [DEBUG   ] Got command RPT from MCS: ref #840449
2018-12-15 01:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840449  77 58467  4254758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:11:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:11:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 01:11:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:11:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:11:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:11:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:11:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:11:12 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-15 01:11:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 01:11:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 01:11:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 01:12:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 01:12:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:12:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:12:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:12:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:12:12 [WARNING ] (13, 1, 'bot')
2018-12-15 01:12:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:12:12 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-12-15 01:12:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 01:12:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 01:12:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 01:13:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 01:13:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:13:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:13:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:13:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:13:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:13:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:13:13 [DEBUG   ] Finished updating board flags in 2.245 seconds
2018-12-15 01:13:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 01:13:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 01:13:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 01:14:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:14:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:14:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:14:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:14:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:14:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:14:13 [DEBUG   ] Finished updating board flags in 2.200 seconds
2018-12-15 01:14:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 01:14:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 01:14:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 01:15:08 [DEBUG   ] Got command RPT from MCS: ref #840473
2018-12-15 01:15:08 [DEBUG   ] summary = ERROR
2018-12-15 01:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840473  13 58467  4508285 A  ERRORERROR'
2018-12-15 01:15:08 [DEBUG   ] Got command RPT from MCS: ref #840474
2018-12-15 01:15:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840474  77 58467  4508489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:15:08 [DEBUG   ] Got command RPT from MCS: ref #840475
2018-12-15 01:15:08 [DEBUG   ] summary = ERROR
2018-12-15 01:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840475  13 58467  4508681 A  ERRORERROR'
2018-12-15 01:15:08 [DEBUG   ] Got command RPT from MCS: ref #840476
2018-12-15 01:15:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:15:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840476  77 58467  4508885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:15:09 [DEBUG   ] Got command RPT from MCS: ref #840477
2018-12-15 01:15:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840477  12 58467  4509089 A  ERRORB—™š'
2018-12-15 01:15:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:15:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:15:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:15:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:15:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:15:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:15:13 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-12-15 01:15:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 01:15:34 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-15 01:15:54 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-15 01:15:54 [DEBUG   ] Got command RPT from MCS: ref #840478
2018-12-15 01:15:54 [DEBUG   ] summary = ERROR
2018-12-15 01:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840478  13 58467  4554753 A  ERRORERROR'
2018-12-15 01:15:54 [DEBUG   ] Got command RPT from MCS: ref #840479
2018-12-15 01:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840479  77 58467  4554754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:16:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:16:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:16:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:16:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:16:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:16:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:16:13 [DEBUG   ] Finished updating board flags in 1.909 seconds
2018-12-15 01:16:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 01:16:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 01:16:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 01:17:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:17:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 01:17:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:17:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:17:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:17:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:17:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:17:13 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-15 01:17:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 01:17:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 01:17:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 01:18:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:18:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:18:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:18:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:18:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:18:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:18:13 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-15 01:18:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-15 01:18:34 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-12-15 01:18:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 01:19:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:19:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:19:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:19:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:19:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:19:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:19:13 [DEBUG   ] Finished updating board flags in 1.781 seconds
2018-12-15 01:19:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 01:19:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 01:19:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 01:20:08 [DEBUG   ] Got command RPT from MCS: ref #840501
2018-12-15 01:20:08 [DEBUG   ] summary = ERROR
2018-12-15 01:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840501  13 58467  4808361 A  ERRORERROR'
2018-12-15 01:20:08 [DEBUG   ] Got command RPT from MCS: ref #840502
2018-12-15 01:20:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840502  77 58467  4808565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:20:08 [DEBUG   ] Got command RPT from MCS: ref #840503
2018-12-15 01:20:08 [DEBUG   ] summary = ERROR
2018-12-15 01:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840503  13 58467  4808769 A  ERRORERROR'
2018-12-15 01:20:08 [DEBUG   ] Got command RPT from MCS: ref #840505
2018-12-15 01:20:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:20:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840505  77 58467  4808965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:20:09 [DEBUG   ] Got command RPT from MCS: ref #840506
2018-12-15 01:20:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840506  12 58467  4809169 A  ERRORB—™š'
2018-12-15 01:20:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:20:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 01:20:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:20:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:20:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:20:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:20:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:20:13 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-12-15 01:20:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-15 01:20:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 01:20:54 [DEBUG   ] Got command RPT from MCS: ref #840515
2018-12-15 01:20:54 [DEBUG   ] summary = ERROR
2018-12-15 01:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840515  13 58467  4854757 A  ERRORERROR'
2018-12-15 01:20:54 [DEBUG   ] Got command RPT from MCS: ref #840516
2018-12-15 01:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840516  77 58467  4854758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:20:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 01:21:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:21:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:21:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:21:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:21:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:21:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:21:13 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-12-15 01:21:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 01:21:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 01:21:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 01:22:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:22:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:22:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:22:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:22:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:22:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:22:13 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-12-15 01:22:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 01:22:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 01:22:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 01:23:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:23:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:23:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:23:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:23:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:23:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:23:13 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-12-15 01:23:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 01:23:36 [DEBUG   ] Finished updating ant stats in 1.344 seconds
2018-12-15 01:23:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 01:24:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:24:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:24:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:24:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:24:13 [WARNING ] (13, 1, 'bot')
2018-12-15 01:24:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:24:13 [DEBUG   ] Finished updating board flags in 1.373 seconds
2018-12-15 01:24:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 01:24:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 01:24:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 01:25:08 [DEBUG   ] Got command RPT from MCS: ref #840536
2018-12-15 01:25:08 [DEBUG   ] summary = ERROR
2018-12-15 01:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840536  13 58467  5108441 A  ERRORERROR'
2018-12-15 01:25:08 [DEBUG   ] Got command RPT from MCS: ref #840537
2018-12-15 01:25:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840537  77 58467  5108645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:25:08 [DEBUG   ] Got command RPT from MCS: ref #840538
2018-12-15 01:25:08 [DEBUG   ] summary = ERROR
2018-12-15 01:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840538  13 58467  5108849 A  ERRORERROR'
2018-12-15 01:25:09 [DEBUG   ] Got command RPT from MCS: ref #840539
2018-12-15 01:25:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840539  77 58467  5109041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:25:09 [DEBUG   ] Got command RPT from MCS: ref #840540
2018-12-15 01:25:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840540  12 58467  5109245 A  ERRORB•™š'
2018-12-15 01:25:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:25:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:25:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:25:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:25:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:25:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:25:14 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-12-15 01:25:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 01:25:36 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2018-12-15 01:25:54 [DEBUG   ] Got command RPT from MCS: ref #840541
2018-12-15 01:25:54 [DEBUG   ] summary = ERROR
2018-12-15 01:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840541  13 58467  5154761 A  ERRORERROR'
2018-12-15 01:25:54 [DEBUG   ] Got command RPT from MCS: ref #840542
2018-12-15 01:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840542  77 58467  5154762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:25:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 01:26:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:26:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:26:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:26:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:26:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:26:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:26:14 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-12-15 01:26:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 01:26:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 01:26:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 01:27:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:27:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:27:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:27:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:27:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:27:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:27:14 [DEBUG   ] Finished updating board flags in 1.914 seconds
2018-12-15 01:27:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 01:27:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 01:27:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 01:28:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 01:28:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:28:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:28:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:28:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:28:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:28:14 [DEBUG   ] Finished updating board flags in 1.702 seconds
2018-12-15 01:28:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 01:28:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 01:28:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 01:29:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:29:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:29:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:29:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:29:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:29:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:29:14 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-12-15 01:29:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 01:29:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 01:29:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 01:30:08 [DEBUG   ] Got command RPT from MCS: ref #840568
2018-12-15 01:30:08 [DEBUG   ] summary = ERROR
2018-12-15 01:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840568  13 58467  5408521 A  ERRORERROR'
2018-12-15 01:30:08 [DEBUG   ] Got command RPT from MCS: ref #840569
2018-12-15 01:30:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840569  77 58467  5408725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:30:08 [DEBUG   ] Got command RPT from MCS: ref #840570
2018-12-15 01:30:08 [DEBUG   ] summary = ERROR
2018-12-15 01:30:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840570  13 58467  5408929 A  ERRORERROR'
2018-12-15 01:30:09 [DEBUG   ] Got command RPT from MCS: ref #840572
2018-12-15 01:30:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840572  77 58467  5409133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:30:09 [DEBUG   ] Got command RPT from MCS: ref #840573
2018-12-15 01:30:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840573  12 58467  5409325 A  ERRORB•™š'
2018-12-15 01:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:30:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:30:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:30:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:30:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:30:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:30:14 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-12-15 01:30:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 01:30:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 01:30:54 [DEBUG   ] Got command RPT from MCS: ref #840578
2018-12-15 01:30:54 [DEBUG   ] summary = ERROR
2018-12-15 01:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840578  13 58467  5454757 A  ERRORERROR'
2018-12-15 01:30:54 [DEBUG   ] Got command RPT from MCS: ref #840579
2018-12-15 01:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840579  77 58467  5454758 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:30:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 01:31:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 01:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:31:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:31:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:31:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:31:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:31:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:31:14 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-12-15 01:31:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 01:31:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 01:31:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 01:32:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 01:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:32:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:32:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:32:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:32:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:32:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:32:14 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-12-15 01:32:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 01:32:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 01:32:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 01:33:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:33:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:33:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:33:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:33:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:33:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:33:14 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-12-15 01:33:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 01:33:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 01:33:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 01:34:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:34:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:34:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:34:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:34:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:34:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:34:14 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-12-15 01:34:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-15 01:34:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-15 01:34:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 01:35:08 [DEBUG   ] Got command RPT from MCS: ref #840599
2018-12-15 01:35:08 [DEBUG   ] summary = ERROR
2018-12-15 01:35:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840599  13 58467  5708605 A  ERRORERROR'
2018-12-15 01:35:08 [DEBUG   ] Got command RPT from MCS: ref #840600
2018-12-15 01:35:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:35:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840600  77 58467  5708809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:35:09 [DEBUG   ] Got command RPT from MCS: ref #840601
2018-12-15 01:35:09 [DEBUG   ] summary = ERROR
2018-12-15 01:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840601  13 58467  5709001 A  ERRORERROR'
2018-12-15 01:35:09 [DEBUG   ] Got command RPT from MCS: ref #840602
2018-12-15 01:35:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840602  77 58467  5709205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:35:09 [DEBUG   ] Got command RPT from MCS: ref #840603
2018-12-15 01:35:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840603  12 58467  5709409 A  ERRORB—™š'
2018-12-15 01:35:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 01:35:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:35:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:35:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:35:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:35:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:35:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:35:14 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-12-15 01:35:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 01:35:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 01:35:54 [DEBUG   ] Got command RPT from MCS: ref #840608
2018-12-15 01:35:54 [DEBUG   ] summary = ERROR
2018-12-15 01:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840608  13 58467  5754753 A  ERRORERROR'
2018-12-15 01:35:54 [DEBUG   ] Got command RPT from MCS: ref #840609
2018-12-15 01:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840609  77 58467  5754754 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:35:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 01:36:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:36:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:36:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:36:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:36:14 [WARNING ] (13, 1, 'bot')
2018-12-15 01:36:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:36:14 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-12-15 01:36:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 01:36:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 01:36:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 01:37:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:37:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:37:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:37:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:37:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:37:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:37:15 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-12-15 01:37:18 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-12-15 01:37:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 01:37:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 01:38:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:38:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 01:38:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:38:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:38:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:38:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:38:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:38:15 [DEBUG   ] Finished updating board flags in 2.133 seconds
2018-12-15 01:38:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 01:38:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 01:38:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 01:39:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:39:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:39:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:39:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:39:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:39:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:39:15 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-12-15 01:39:18 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-15 01:39:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 01:39:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 01:40:08 [DEBUG   ] Got command RPT from MCS: ref #840631
2018-12-15 01:40:08 [DEBUG   ] summary = ERROR
2018-12-15 01:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840631  13 58467  6008689 A  ERRORERROR'
2018-12-15 01:40:08 [DEBUG   ] Got command RPT from MCS: ref #840632
2018-12-15 01:40:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:40:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840632  77 58467  6008881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:40:09 [DEBUG   ] Got command RPT from MCS: ref #840633
2018-12-15 01:40:09 [DEBUG   ] summary = ERROR
2018-12-15 01:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840633  13 58467  6009085 A  ERRORERROR'
2018-12-15 01:40:09 [DEBUG   ] Got command RPT from MCS: ref #840635
2018-12-15 01:40:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840635  77 58467  6009281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:40:09 [DEBUG   ] Got command RPT from MCS: ref #840636
2018-12-15 01:40:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840636  12 58467  6009485 A  ERRORB–™š'
2018-12-15 01:40:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:40:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:40:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:40:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:40:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:40:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:40:15 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-12-15 01:40:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 01:40:39 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 01:40:54 [DEBUG   ] Got command RPT from MCS: ref #840641
2018-12-15 01:40:54 [DEBUG   ] summary = ERROR
2018-12-15 01:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840641  13 58467  6054765 A  ERRORERROR'
2018-12-15 01:40:54 [DEBUG   ] Got command RPT from MCS: ref #840642
2018-12-15 01:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840642  77 58467  6054766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:40:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 01:41:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-12-15 01:41:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:41:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:41:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:41:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:41:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:41:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:41:15 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-12-15 01:41:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 01:41:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 01:41:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 01:42:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:42:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:42:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:42:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:42:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:42:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:42:15 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-12-15 01:42:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 01:42:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-15 01:42:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 01:43:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:43:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:43:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:43:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:43:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:43:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:43:15 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-12-15 01:43:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 01:43:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 01:43:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 01:44:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:44:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:44:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:44:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:44:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:44:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:44:15 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-12-15 01:44:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 01:44:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 01:44:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 01:45:08 [DEBUG   ] Got command RPT from MCS: ref #840666
2018-12-15 01:45:08 [DEBUG   ] summary = ERROR
2018-12-15 01:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840666  13 58467  6308761 A  ERRORERROR'
2018-12-15 01:45:08 [DEBUG   ] Got command RPT from MCS: ref #840667
2018-12-15 01:45:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:45:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840667  77 58467  6308965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:45:09 [DEBUG   ] Got command RPT from MCS: ref #840668
2018-12-15 01:45:09 [DEBUG   ] summary = ERROR
2018-12-15 01:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840668  13 58467  6309169 A  ERRORERROR'
2018-12-15 01:45:09 [DEBUG   ] Got command RPT from MCS: ref #840669
2018-12-15 01:45:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840669  77 58467  6309361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:45:09 [DEBUG   ] Got command RPT from MCS: ref #840670
2018-12-15 01:45:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840670  12 58467  6309565 A  ERRORB•™š'
2018-12-15 01:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:45:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:45:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:45:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:45:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:45:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:45:15 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-12-15 01:45:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 01:45:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 01:45:54 [DEBUG   ] Got command RPT from MCS: ref #840671
2018-12-15 01:45:54 [DEBUG   ] summary = ERROR
2018-12-15 01:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840671  13 58467  6354761 A  ERRORERROR'
2018-12-15 01:45:54 [DEBUG   ] Got command RPT from MCS: ref #840672
2018-12-15 01:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840672  77 58467  6354762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:46:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 01:46:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:46:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:46:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:46:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:46:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:46:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:46:15 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-12-15 01:46:20 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 01:46:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 01:47:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 01:47:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:47:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:47:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:47:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:47:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:47:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:47:15 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-12-15 01:47:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 01:47:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 01:48:00 [DEBUG   ] Finished updating ant stats in 0.750 seconds
2018-12-15 01:48:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:48:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:48:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:48:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:48:15 [WARNING ] (13, 1, 'bot')
2018-12-15 01:48:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:48:15 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-12-15 01:48:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 01:48:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 01:49:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-15 01:49:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:49:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:49:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:49:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:49:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:49:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:49:16 [DEBUG   ] Finished updating board flags in 2.042 seconds
2018-12-15 01:49:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 01:49:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 01:50:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-12-15 01:50:08 [DEBUG   ] Got command RPT from MCS: ref #840694
2018-12-15 01:50:08 [DEBUG   ] summary = ERROR
2018-12-15 01:50:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840694  13 58467  6608845 A  ERRORERROR'
2018-12-15 01:50:09 [DEBUG   ] Got command RPT from MCS: ref #840695
2018-12-15 01:50:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840695  77 58467  6609049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:50:09 [DEBUG   ] Got command RPT from MCS: ref #840696
2018-12-15 01:50:09 [DEBUG   ] summary = ERROR
2018-12-15 01:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840696  13 58467  6609241 A  ERRORERROR'
2018-12-15 01:50:09 [DEBUG   ] Got command RPT from MCS: ref #840698
2018-12-15 01:50:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840698  77 58467  6609445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:50:09 [DEBUG   ] Got command RPT from MCS: ref #840699
2018-12-15 01:50:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840699  12 58467  6609649 A  ERRORB•™š'
2018-12-15 01:50:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:50:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 01:50:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:50:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:50:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:50:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:50:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:50:16 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-12-15 01:50:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 01:50:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 01:50:54 [DEBUG   ] Got command RPT from MCS: ref #840708
2018-12-15 01:50:54 [DEBUG   ] summary = ERROR
2018-12-15 01:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840708  13 58467  6654761 A  ERRORERROR'
2018-12-15 01:50:54 [DEBUG   ] Got command RPT from MCS: ref #840709
2018-12-15 01:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840709  77 58467  6654762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:51:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-12-15 01:51:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 01:51:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:51:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:51:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:51:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:51:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:51:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:51:16 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-12-15 01:51:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 01:51:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 01:52:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 01:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:52:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:52:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:52:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:52:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:52:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:52:16 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-15 01:52:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 01:52:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 01:53:01 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 01:53:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:53:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:53:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:53:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:53:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:53:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:53:16 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-12-15 01:53:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 01:53:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 01:54:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 01:54:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:54:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:54:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:54:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:54:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:54:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:54:16 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-15 01:54:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 01:54:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 01:55:02 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-15 01:55:08 [DEBUG   ] Got command RPT from MCS: ref #840729
2018-12-15 01:55:08 [DEBUG   ] summary = ERROR
2018-12-15 01:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840729  13 58467  6908921 A  ERRORERROR'
2018-12-15 01:55:09 [DEBUG   ] Got command RPT from MCS: ref #840730
2018-12-15 01:55:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840730  77 58467  6909125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:55:09 [DEBUG   ] Got command RPT from MCS: ref #840731
2018-12-15 01:55:09 [DEBUG   ] summary = ERROR
2018-12-15 01:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840731  13 58467  6909329 A  ERRORERROR'
2018-12-15 01:55:09 [DEBUG   ] Got command RPT from MCS: ref #840732
2018-12-15 01:55:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840732  77 58467  6909533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:55:09 [DEBUG   ] Got command RPT from MCS: ref #840733
2018-12-15 01:55:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 01:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840733  12 58467  6909725 A  ERRORB—™š'
2018-12-15 01:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:55:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 01:55:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:55:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:55:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:55:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:55:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:55:16 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-12-15 01:55:21 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-12-15 01:55:41 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-12-15 01:55:54 [DEBUG   ] Got command RPT from MCS: ref #840734
2018-12-15 01:55:54 [DEBUG   ] summary = ERROR
2018-12-15 01:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840734  13 58467  6954761 A  ERRORERROR'
2018-12-15 01:55:54 [DEBUG   ] Got command RPT from MCS: ref #840735
2018-12-15 01:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 01:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840735  77 58467  6954762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 01:56:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 01:56:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 01:56:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:56:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:56:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:56:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:56:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:56:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:56:16 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-12-15 01:56:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 01:56:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 01:57:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 01:57:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:57:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:57:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:57:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:57:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:57:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:57:16 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-12-15 01:57:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 01:57:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 01:58:02 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-15 01:58:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:58:17 [WARNING ] (13, 1, 'bot')
2018-12-15 01:58:17 [WARNING ] (13, 1, 'bot')
2018-12-15 01:58:17 [WARNING ] (13, 1, 'bot')
2018-12-15 01:58:17 [WARNING ] (13, 1, 'bot')
2018-12-15 01:58:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:58:17 [DEBUG   ] Finished updating board flags in 2.400 seconds
2018-12-15 01:58:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 01:58:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 01:59:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 01:59:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 01:59:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:59:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:59:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:59:16 [WARNING ] (13, 1, 'bot')
2018-12-15 01:59:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 01:59:16 [DEBUG   ] Finished updating board flags in 1.323 seconds
2018-12-15 01:59:22 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-15 01:59:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 02:00:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 02:00:09 [DEBUG   ] Got command RPT from MCS: ref #840761
2018-12-15 02:00:09 [DEBUG   ] summary = ERROR
2018-12-15 02:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840761  13 58467  7209009 A  ERRORERROR'
2018-12-15 02:00:09 [DEBUG   ] Got command RPT from MCS: ref #840762
2018-12-15 02:00:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840762  77 58467  7209201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:00:09 [DEBUG   ] Got command RPT from MCS: ref #840763
2018-12-15 02:00:09 [DEBUG   ] summary = ERROR
2018-12-15 02:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840763  13 58467  7209405 A  ERRORERROR'
2018-12-15 02:00:09 [DEBUG   ] Got command RPT from MCS: ref #840765
2018-12-15 02:00:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840765  77 58467  7209609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:00:09 [DEBUG   ] Got command RPT from MCS: ref #840766
2018-12-15 02:00:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840766  12 58467  7209801 A  ERRORB—™š'
2018-12-15 02:00:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:00:16 [WARNING ] (13, 1, 'bot')
2018-12-15 02:00:16 [WARNING ] (13, 1, 'bot')
2018-12-15 02:00:16 [WARNING ] (13, 1, 'bot')
2018-12-15 02:00:16 [WARNING ] (13, 1, 'bot')
2018-12-15 02:00:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:00:16 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-12-15 02:00:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 02:00:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 02:00:54 [DEBUG   ] Got command RPT from MCS: ref #840771
2018-12-15 02:00:54 [DEBUG   ] summary = ERROR
2018-12-15 02:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840771  13 58467  7254769 A  ERRORERROR'
2018-12-15 02:00:54 [DEBUG   ] Got command RPT from MCS: ref #840772
2018-12-15 02:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840772  77 58467  7254770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:01:03 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 02:01:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:01:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:01:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:01:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:01:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:01:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:01:17 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-12-15 02:01:23 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-12-15 02:01:42 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2018-12-15 02:02:03 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 02:02:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:02:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:02:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:02:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:02:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:02:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:02:17 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-12-15 02:02:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 02:02:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 02:03:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:03:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:03:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:03:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:03:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:03:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:03:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:03:17 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-15 02:03:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:03:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 02:04:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 02:04:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:04:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:04:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:04:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:04:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:04:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:04:17 [DEBUG   ] Finished updating board flags in 1.833 seconds
2018-12-15 02:04:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 02:04:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 02:05:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 02:05:09 [DEBUG   ] Got command RPT from MCS: ref #840792
2018-12-15 02:05:09 [DEBUG   ] summary = ERROR
2018-12-15 02:05:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840792  13 58467  7509089 A  ERRORERROR'
2018-12-15 02:05:09 [DEBUG   ] Got command RPT from MCS: ref #840793
2018-12-15 02:05:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:05:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840793  77 58467  7509281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:05:09 [DEBUG   ] Got command RPT from MCS: ref #840794
2018-12-15 02:05:09 [DEBUG   ] summary = ERROR
2018-12-15 02:05:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840794  13 58467  7509485 A  ERRORERROR'
2018-12-15 02:05:09 [DEBUG   ] Got command RPT from MCS: ref #840795
2018-12-15 02:05:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:05:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840795  77 58467  7509689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:05:09 [DEBUG   ] Got command RPT from MCS: ref #840796
2018-12-15 02:05:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:05:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840796  12 58467  7509881 A  ERRORB–™š'
2018-12-15 02:05:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:05:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:05:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:05:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:05:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:05:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:05:17 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-15 02:05:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 02:05:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 02:05:54 [DEBUG   ] Got command RPT from MCS: ref #840801
2018-12-15 02:05:54 [DEBUG   ] summary = ERROR
2018-12-15 02:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840801  13 58467  7554761 A  ERRORERROR'
2018-12-15 02:05:54 [DEBUG   ] Got command RPT from MCS: ref #840802
2018-12-15 02:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840802  77 58467  7554762 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:06:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 02:06:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:06:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:06:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:06:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:06:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:06:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:06:17 [DEBUG   ] Finished updating board flags in 1.753 seconds
2018-12-15 02:06:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 02:06:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 02:07:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 02:07:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:07:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:07:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:07:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:07:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:07:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:07:17 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-15 02:07:24 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 02:07:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 02:08:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 02:08:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:08:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:08:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:08:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:08:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:08:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:08:17 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-12-15 02:08:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 02:08:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 02:09:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 02:09:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:09:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:09:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:09:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:09:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:09:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:09:17 [DEBUG   ] Finished updating board flags in 1.464 seconds
2018-12-15 02:09:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 02:09:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 02:10:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 02:10:09 [DEBUG   ] Got command RPT from MCS: ref #840824
2018-12-15 02:10:09 [DEBUG   ] summary = ERROR
2018-12-15 02:10:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840824  13 58467  7809165 A  ERRORERROR'
2018-12-15 02:10:09 [DEBUG   ] Got command RPT from MCS: ref #840825
2018-12-15 02:10:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:10:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840825  77 58467  7809357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:10:09 [DEBUG   ] Got command RPT from MCS: ref #840826
2018-12-15 02:10:09 [DEBUG   ] summary = ERROR
2018-12-15 02:10:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840826  13 58467  7809565 A  ERRORERROR'
2018-12-15 02:10:09 [DEBUG   ] Got command RPT from MCS: ref #840828
2018-12-15 02:10:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:10:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840828  77 58467  7809769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:10:09 [DEBUG   ] Got command RPT from MCS: ref #840829
2018-12-15 02:10:09 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:10:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840829  12 58467  7809961 A  ERRORB•™š'
2018-12-15 02:10:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:10:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:10:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:10:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:10:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:10:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:10:17 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-12-15 02:10:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 02:10:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 02:10:54 [DEBUG   ] Got command RPT from MCS: ref #840834
2018-12-15 02:10:54 [DEBUG   ] summary = ERROR
2018-12-15 02:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840834  13 58467  7854765 A  ERRORERROR'
2018-12-15 02:10:54 [DEBUG   ] Got command RPT from MCS: ref #840835
2018-12-15 02:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840835  77 58467  7854766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:11:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 02:11:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:11:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 02:11:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:11:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:11:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:11:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:11:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:11:17 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-12-15 02:11:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 02:11:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 02:12:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 02:12:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:12:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:12:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:12:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:12:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:12:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:12:17 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-12-15 02:12:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 02:12:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 02:13:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 02:13:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:13:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:13:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:13:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:13:17 [WARNING ] (13, 1, 'bot')
2018-12-15 02:13:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:13:17 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-12-15 02:13:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 02:13:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 02:14:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 02:14:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:14:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:14:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:14:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:14:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:14:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:14:18 [DEBUG   ] Finished updating board flags in 2.192 seconds
2018-12-15 02:14:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 02:14:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 02:15:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 02:15:09 [DEBUG   ] Got command RPT from MCS: ref #840859
2018-12-15 02:15:09 [DEBUG   ] summary = ERROR
2018-12-15 02:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840859  13 58467  8109241 A  ERRORERROR'
2018-12-15 02:15:09 [DEBUG   ] Got command RPT from MCS: ref #840860
2018-12-15 02:15:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840860  77 58467  8109445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:15:09 [DEBUG   ] Got command RPT from MCS: ref #840861
2018-12-15 02:15:09 [DEBUG   ] summary = ERROR
2018-12-15 02:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840861  13 58467  8109649 A  ERRORERROR'
2018-12-15 02:15:09 [DEBUG   ] Got command RPT from MCS: ref #840862
2018-12-15 02:15:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840862  77 58467  8109841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:15:10 [DEBUG   ] Got command RPT from MCS: ref #840863
2018-12-15 02:15:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840863  12 58467  8110045 A  ERRORB—™š'
2018-12-15 02:15:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:15:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:15:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:15:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:15:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:15:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:15:18 [DEBUG   ] Finished updating board flags in 1.928 seconds
2018-12-15 02:15:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 02:15:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 02:15:54 [DEBUG   ] Got command RPT from MCS: ref #840864
2018-12-15 02:15:54 [DEBUG   ] summary = ERROR
2018-12-15 02:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840864  13 58467  8154769 A  ERRORERROR'
2018-12-15 02:15:54 [DEBUG   ] Got command RPT from MCS: ref #840865
2018-12-15 02:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840865  77 58467  8154770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:16:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 02:16:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:16:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:16:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:16:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:16:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:16:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:16:18 [DEBUG   ] Finished updating board flags in 1.847 seconds
2018-12-15 02:16:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 02:16:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 02:17:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 02:17:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:17:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 02:17:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:17:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:17:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:17:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:17:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:17:18 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-12-15 02:17:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 02:17:45 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 02:18:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 02:18:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:18:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:18:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:18:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:18:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:18:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:18:18 [DEBUG   ] Finished updating board flags in 1.559 seconds
2018-12-15 02:18:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 02:18:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:19:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 02:19:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:19:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:19:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:19:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:19:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:19:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:19:18 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-12-15 02:19:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 02:19:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 02:20:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-15 02:20:09 [DEBUG   ] Got command RPT from MCS: ref #840887
2018-12-15 02:20:09 [DEBUG   ] summary = ERROR
2018-12-15 02:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840887  13 58467  8409321 A  ERRORERROR'
2018-12-15 02:20:09 [DEBUG   ] Got command RPT from MCS: ref #840888
2018-12-15 02:20:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840888  77 58467  8409526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:20:09 [DEBUG   ] Got command RPT from MCS: ref #840889
2018-12-15 02:20:09 [DEBUG   ] summary = ERROR
2018-12-15 02:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840889  13 58467  8409729 A  ERRORERROR'
2018-12-15 02:20:09 [DEBUG   ] Got command RPT from MCS: ref #840891
2018-12-15 02:20:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:20:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840891  77 58467  8409921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:20:10 [DEBUG   ] Got command RPT from MCS: ref #840893
2018-12-15 02:20:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840893  12 58467  8410126 A  ERRORB–™š'
2018-12-15 02:20:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:20:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:20:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:20:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:20:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:20:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:20:18 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-12-15 02:20:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 02:20:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 02:20:54 [DEBUG   ] Got command RPT from MCS: ref #840901
2018-12-15 02:20:54 [DEBUG   ] summary = ERROR
2018-12-15 02:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840901  13 58467  8454765 A  ERRORERROR'
2018-12-15 02:20:54 [DEBUG   ] Got command RPT from MCS: ref #840902
2018-12-15 02:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840902  77 58467  8454766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:21:06 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-15 02:21:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:21:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:21:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:21:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:21:18 [WARNING ] (13, 1, 'bot')
2018-12-15 02:21:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:21:18 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-12-15 02:21:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 02:21:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 02:22:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:22:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:22:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:22:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:22:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:22:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:22:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:22:19 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-12-15 02:22:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:22:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 02:23:06 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-15 02:23:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:23:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:23:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:23:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:23:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:23:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:23:19 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-12-15 02:23:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 02:23:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 02:24:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 02:24:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:24:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:24:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:24:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:24:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:24:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:24:19 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-12-15 02:24:26 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-15 02:24:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 02:25:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 02:25:09 [DEBUG   ] Got command RPT from MCS: ref #840922
2018-12-15 02:25:09 [DEBUG   ] summary = ERROR
2018-12-15 02:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840922  13 58467  8709397 A  ERRORERROR'
2018-12-15 02:25:09 [DEBUG   ] Got command RPT from MCS: ref #840923
2018-12-15 02:25:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840923  77 58467  8709601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:25:09 [DEBUG   ] Got command RPT from MCS: ref #840924
2018-12-15 02:25:09 [DEBUG   ] summary = ERROR
2018-12-15 02:25:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840924  13 58467  8709805 A  ERRORERROR'
2018-12-15 02:25:10 [DEBUG   ] Got command RPT from MCS: ref #840925
2018-12-15 02:25:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840925  77 58467  8710009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:25:10 [DEBUG   ] Got command RPT from MCS: ref #840926
2018-12-15 02:25:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840926  12 58467  8710201 A  ERRORB•™š'
2018-12-15 02:25:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:25:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:25:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:25:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:25:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:25:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:25:19 [DEBUG   ] Finished updating board flags in 1.712 seconds
2018-12-15 02:25:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 02:25:47 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-15 02:25:54 [DEBUG   ] Got command RPT from MCS: ref #840927
2018-12-15 02:25:54 [DEBUG   ] summary = ERROR
2018-12-15 02:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840927  13 58467  8754773 A  ERRORERROR'
2018-12-15 02:25:54 [DEBUG   ] Got command RPT from MCS: ref #840928
2018-12-15 02:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840928  77 58467  8754774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:26:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 02:26:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:26:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:26:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:26:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:26:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:26:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:26:19 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-12-15 02:26:27 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-12-15 02:26:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 02:27:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:27:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:27:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:27:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:27:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:27:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:27:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:27:19 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-12-15 02:27:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-15 02:27:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 02:28:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 02:28:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:28:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:28:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:28:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:28:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:28:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:28:19 [DEBUG   ] Finished updating board flags in 1.445 seconds
2018-12-15 02:28:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 02:28:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-15 02:29:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 02:29:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:29:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:29:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:29:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:29:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:29:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:29:19 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-12-15 02:29:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 02:29:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 02:30:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 02:30:09 [DEBUG   ] Got command RPT from MCS: ref #840954
2018-12-15 02:30:09 [DEBUG   ] summary = ERROR
2018-12-15 02:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840954  13 58467  9009481 A  ERRORERROR'
2018-12-15 02:30:09 [DEBUG   ] Got command RPT from MCS: ref #840955
2018-12-15 02:30:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840955  77 58467  9009685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:30:09 [DEBUG   ] Got command RPT from MCS: ref #840956
2018-12-15 02:30:09 [DEBUG   ] summary = ERROR
2018-12-15 02:30:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840956  13 58467  9009877 A  ERRORERROR'
2018-12-15 02:30:10 [DEBUG   ] Got command RPT from MCS: ref #840958
2018-12-15 02:30:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840958  77 58467  9010081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:30:10 [DEBUG   ] Got command RPT from MCS: ref #840959
2018-12-15 02:30:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840959  12 58467  9010285 A  ERRORB•™š'
2018-12-15 02:30:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:30:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:30:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:30:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:30:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:30:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:30:19 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-12-15 02:30:27 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2018-12-15 02:30:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 02:30:54 [DEBUG   ] Got command RPT from MCS: ref #840964
2018-12-15 02:30:54 [DEBUG   ] summary = ERROR
2018-12-15 02:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840964  13 58467  9054769 A  ERRORERROR'
2018-12-15 02:30:54 [DEBUG   ] Got command RPT from MCS: ref #840965
2018-12-15 02:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840965  77 58467  9054770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:31:08 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 02:31:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:31:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 02:31:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:31:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:31:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:31:19 [WARNING ] (13, 1, 'bot')
2018-12-15 02:31:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:31:19 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-12-15 02:31:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 02:31:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 02:32:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 02:32:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:32:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:32:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:32:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:32:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:32:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:32:20 [DEBUG   ] Finished updating board flags in 2.180 seconds
2018-12-15 02:32:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 02:32:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 02:33:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:33:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:33:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:33:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:33:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:33:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:33:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:33:20 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-12-15 02:33:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 02:33:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-15 02:34:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 02:34:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:34:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:34:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:34:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:34:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:34:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:34:20 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-12-15 02:34:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 02:34:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 02:35:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-15 02:35:09 [DEBUG   ] Got command RPT from MCS: ref #840985
2018-12-15 02:35:09 [DEBUG   ] summary = ERROR
2018-12-15 02:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840985  13 58467  9309565 A  ERRORERROR'
2018-12-15 02:35:09 [DEBUG   ] Got command RPT from MCS: ref #840986
2018-12-15 02:35:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840986  77 58467  9309757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:35:09 [DEBUG   ] Got command RPT from MCS: ref #840987
2018-12-15 02:35:09 [DEBUG   ] summary = ERROR
2018-12-15 02:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840987  13 58467  9309961 A  ERRORERROR'
2018-12-15 02:35:10 [DEBUG   ] Got command RPT from MCS: ref #840988
2018-12-15 02:35:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840988  77 58467  9310165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:35:10 [DEBUG   ] Got command RPT from MCS: ref #840989
2018-12-15 02:35:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840989  12 58467  9310369 A  ERRORB—™š'
2018-12-15 02:35:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 02:35:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:35:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:35:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:35:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:35:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:35:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:35:20 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-12-15 02:35:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 02:35:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 02:35:54 [DEBUG   ] Got command RPT from MCS: ref #840994
2018-12-15 02:35:54 [DEBUG   ] summary = ERROR
2018-12-15 02:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840994  13 58467  9354765 A  ERRORERROR'
2018-12-15 02:35:54 [DEBUG   ] Got command RPT from MCS: ref #840995
2018-12-15 02:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   840995  77 58467  9354766 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:36:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 02:36:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:36:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:36:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:36:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:36:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:36:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:36:20 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-15 02:36:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 02:36:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 02:37:09 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 02:37:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 02:37:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:37:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:37:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:37:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:37:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:37:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:37:20 [DEBUG   ] Finished updating board flags in 1.583 seconds
2018-12-15 02:37:29 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 02:37:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 02:38:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 02:38:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:38:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:38:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:38:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:38:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:38:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:38:20 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-15 02:38:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 02:38:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 02:39:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 02:39:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:39:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:39:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:39:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:39:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:39:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:39:20 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-12-15 02:39:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 02:39:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 02:40:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 02:40:09 [DEBUG   ] Got command RPT from MCS: ref #841017
2018-12-15 02:40:09 [DEBUG   ] summary = ERROR
2018-12-15 02:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841017  13 58467  9609645 A  ERRORERROR'
2018-12-15 02:40:09 [DEBUG   ] Got command RPT from MCS: ref #841018
2018-12-15 02:40:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841018  77 58467  9609837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:40:10 [DEBUG   ] Got command RPT from MCS: ref #841019
2018-12-15 02:40:10 [DEBUG   ] summary = ERROR
2018-12-15 02:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841019  13 58467  9610041 A  ERRORERROR'
2018-12-15 02:40:10 [DEBUG   ] Got command RPT from MCS: ref #841021
2018-12-15 02:40:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841021  77 58467  9610245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:40:10 [DEBUG   ] Got command RPT from MCS: ref #841022
2018-12-15 02:40:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841022  12 58467  9610449 A  ERRORB–™š'
2018-12-15 02:40:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:40:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 02:40:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 02:40:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:40:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:40:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:40:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:40:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:40:20 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-15 02:40:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 02:40:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 02:40:54 [DEBUG   ] Got command RPT from MCS: ref #841027
2018-12-15 02:40:54 [DEBUG   ] summary = ERROR
2018-12-15 02:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841027  13 58467  9654773 A  ERRORERROR'
2018-12-15 02:40:54 [DEBUG   ] Got command RPT from MCS: ref #841028
2018-12-15 02:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841028  77 58467  9654774 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:41:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 02:41:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:41:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:41:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:41:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:41:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:41:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:41:20 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-15 02:41:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-15 02:41:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 02:42:10 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-15 02:42:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:42:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:42:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:42:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:42:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:42:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:42:20 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-15 02:42:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 02:42:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 02:43:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 02:43:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:43:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:43:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:43:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:43:20 [WARNING ] (13, 1, 'bot')
2018-12-15 02:43:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:43:20 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-12-15 02:43:30 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-15 02:43:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 02:44:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 02:44:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:44:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:44:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:44:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:44:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:44:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:44:21 [DEBUG   ] Finished updating board flags in 2.289 seconds
2018-12-15 02:44:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:44:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 02:45:09 [DEBUG   ] Got command RPT from MCS: ref #841052
2018-12-15 02:45:09 [DEBUG   ] summary = ERROR
2018-12-15 02:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841052  13 58467  9909721 A  ERRORERROR'
2018-12-15 02:45:09 [DEBUG   ] Got command RPT from MCS: ref #841053
2018-12-15 02:45:09 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:45:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841053  77 58467  9909925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:45:10 [DEBUG   ] Got command RPT from MCS: ref #841054
2018-12-15 02:45:10 [DEBUG   ] summary = ERROR
2018-12-15 02:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841054  13 58467  9910117 A  ERRORERROR'
2018-12-15 02:45:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 02:45:10 [DEBUG   ] Got command RPT from MCS: ref #841055
2018-12-15 02:45:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841055  77 58467  9910322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:45:10 [DEBUG   ] Got command RPT from MCS: ref #841056
2018-12-15 02:45:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841056  12 58467  9910525 A  ERRORB•™š'
2018-12-15 02:45:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:45:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 02:45:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:45:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:45:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:45:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:45:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:45:21 [DEBUG   ] Finished updating board flags in 2.092 seconds
2018-12-15 02:45:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 02:45:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 02:45:54 [DEBUG   ] Got command RPT from MCS: ref #841057
2018-12-15 02:45:54 [DEBUG   ] summary = ERROR
2018-12-15 02:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841057  13 58467  9954769 A  ERRORERROR'
2018-12-15 02:45:54 [DEBUG   ] Got command RPT from MCS: ref #841058
2018-12-15 02:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841058  77 58467  9954770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:46:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 02:46:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:46:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:46:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:46:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:46:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:46:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:46:21 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-12-15 02:46:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 02:46:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 02:47:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 02:47:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:47:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:47:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:47:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:47:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:47:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:47:21 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-12-15 02:47:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 02:47:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 02:48:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 02:48:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:48:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:48:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:48:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:48:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:48:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:48:21 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-12-15 02:48:31 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-15 02:48:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-15 02:49:11 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-15 02:49:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:49:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:49:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:49:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:49:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:49:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:49:21 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-15 02:49:31 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-12-15 02:49:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 02:50:09 [DEBUG   ] Got command RPT from MCS: ref #841080
2018-12-15 02:50:09 [DEBUG   ] summary = ERROR
2018-12-15 02:50:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841080  13 58467 10209801 A  ERRORERROR'
2018-12-15 02:50:10 [DEBUG   ] Got command RPT from MCS: ref #841081
2018-12-15 02:50:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841081  77 58467 10210005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:50:10 [DEBUG   ] Got command RPT from MCS: ref #841082
2018-12-15 02:50:10 [DEBUG   ] summary = ERROR
2018-12-15 02:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841082  13 58467 10210197 A  ERRORERROR'
2018-12-15 02:50:10 [DEBUG   ] Got command RPT from MCS: ref #841084
2018-12-15 02:50:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841084  77 58467 10210405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:50:10 [DEBUG   ] Got command RPT from MCS: ref #841085
2018-12-15 02:50:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841085  12 58467 10210597 A  ERRORB–™š'
2018-12-15 02:50:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 02:50:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 02:50:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:50:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-15 02:50:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:50:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:50:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:50:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:50:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:50:21 [DEBUG   ] Finished updating board flags in 1.797 seconds
2018-12-15 02:50:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 02:50:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 02:50:54 [DEBUG   ] Got command RPT from MCS: ref #841094
2018-12-15 02:50:54 [DEBUG   ] summary = ERROR
2018-12-15 02:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841094  13 58467 10254769 A  ERRORERROR'
2018-12-15 02:50:54 [DEBUG   ] Got command RPT from MCS: ref #841095
2018-12-15 02:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841095  77 58467 10254770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:51:11 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-12-15 02:51:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 02:51:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:51:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:51:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:51:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:51:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:51:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:51:21 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-15 02:51:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 02:51:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 02:52:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 02:52:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:52:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:52:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:52:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:52:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:52:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:52:21 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-12-15 02:52:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 02:52:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 02:53:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 02:53:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:53:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 02:53:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:53:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:53:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:53:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:53:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:53:21 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-15 02:53:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 02:53:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 02:54:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 02:54:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 02:54:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:54:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:54:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:54:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:54:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:54:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:54:21 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-12-15 02:54:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 02:54:52 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 02:55:09 [DEBUG   ] Got command RPT from MCS: ref #841115
2018-12-15 02:55:09 [DEBUG   ] summary = ERROR
2018-12-15 02:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841115  13 58467 10509877 A  ERRORERROR'
2018-12-15 02:55:10 [DEBUG   ] Got command RPT from MCS: ref #841116
2018-12-15 02:55:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841116  77 58467 10510081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:55:10 [DEBUG   ] Got command RPT from MCS: ref #841117
2018-12-15 02:55:10 [DEBUG   ] summary = ERROR
2018-12-15 02:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841117  13 58467 10510285 A  ERRORERROR'
2018-12-15 02:55:10 [DEBUG   ] Got command RPT from MCS: ref #841118
2018-12-15 02:55:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841118  77 58467 10510477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:55:10 [DEBUG   ] Got command RPT from MCS: ref #841119
2018-12-15 02:55:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 02:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841119  12 58467 10510681 A  ERRORB—™š'
2018-12-15 02:55:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-15 02:55:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:55:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:55:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:55:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:55:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:55:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:55:21 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-12-15 02:55:32 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-15 02:55:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 02:55:54 [DEBUG   ] Got command RPT from MCS: ref #841120
2018-12-15 02:55:54 [DEBUG   ] summary = ERROR
2018-12-15 02:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841120  13 58467 10554769 A  ERRORERROR'
2018-12-15 02:55:54 [DEBUG   ] Got command RPT from MCS: ref #841121
2018-12-15 02:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 02:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841121  77 58467 10554770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 02:56:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 02:56:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:56:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:56:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:56:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:56:21 [WARNING ] (13, 1, 'bot')
2018-12-15 02:56:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:56:21 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-12-15 02:56:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 02:56:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 02:57:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:57:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:57:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:57:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:57:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:57:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:57:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:57:22 [DEBUG   ] Finished updating board flags in 2.039 seconds
2018-12-15 02:57:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:57:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:58:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 02:58:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:58:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 02:58:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 02:58:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:58:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:58:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:58:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:58:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:58:22 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-12-15 02:58:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 02:58:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 02:59:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 02:59:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 02:59:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:59:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:59:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:59:22 [WARNING ] (13, 1, 'bot')
2018-12-15 02:59:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 02:59:22 [DEBUG   ] Finished updating board flags in 2.107 seconds
2018-12-15 02:59:32 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 02:59:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:00:09 [DEBUG   ] Got command RPT from MCS: ref #841147
2018-12-15 03:00:09 [DEBUG   ] summary = ERROR
2018-12-15 03:00:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841147  13 58467 10809965 A  ERRORERROR'
2018-12-15 03:00:10 [DEBUG   ] Got command RPT from MCS: ref #841148
2018-12-15 03:00:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841148  77 58467 10810157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:00:10 [DEBUG   ] Got command RPT from MCS: ref #841149
2018-12-15 03:00:10 [DEBUG   ] summary = ERROR
2018-12-15 03:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841149  13 58467 10810361 A  ERRORERROR'
2018-12-15 03:00:10 [DEBUG   ] Got command RPT from MCS: ref #841151
2018-12-15 03:00:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841151  77 58467 10810565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:00:10 [DEBUG   ] Got command RPT from MCS: ref #841152
2018-12-15 03:00:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841152  12 58467 10810757 A  ERRORB–™š'
2018-12-15 03:00:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 03:00:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:00:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:00:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:00:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:00:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:00:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:00:22 [DEBUG   ] Finished updating board flags in 1.886 seconds
2018-12-15 03:00:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 03:00:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:00:54 [DEBUG   ] Got command RPT from MCS: ref #841157
2018-12-15 03:00:54 [DEBUG   ] summary = ERROR
2018-12-15 03:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841157  13 58467 10854781 A  ERRORERROR'
2018-12-15 03:00:54 [DEBUG   ] Got command RPT from MCS: ref #841158
2018-12-15 03:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841158  77 58467 10854782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:01:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 03:01:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:01:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:01:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:01:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:01:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:01:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:01:22 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-12-15 03:01:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 03:01:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 03:02:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:02:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:02:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:02:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:02:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:02:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:02:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:02:22 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-12-15 03:02:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 03:02:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 03:03:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 03:03:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:03:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:03:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:03:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:03:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:03:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:03:22 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-12-15 03:03:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:03:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:04:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 03:04:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:04:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 03:04:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:04:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:04:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:04:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:04:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:04:22 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-12-15 03:04:32 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 03:04:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 03:05:10 [DEBUG   ] Got command RPT from MCS: ref #841178
2018-12-15 03:05:10 [DEBUG   ] summary = ERROR
2018-12-15 03:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841178  13 58467 11110037 A  ERRORERROR'
2018-12-15 03:05:10 [DEBUG   ] Got command RPT from MCS: ref #841179
2018-12-15 03:05:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841179  77 58467 11110241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:05:10 [DEBUG   ] Got command RPT from MCS: ref #841180
2018-12-15 03:05:10 [DEBUG   ] summary = ERROR
2018-12-15 03:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841180  13 58467 11110445 A  ERRORERROR'
2018-12-15 03:05:10 [DEBUG   ] Got command RPT from MCS: ref #841181
2018-12-15 03:05:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841181  77 58467 11110637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:05:10 [DEBUG   ] Got command RPT from MCS: ref #841182
2018-12-15 03:05:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841182  12 58467 11110841 A  ERRORB•™š'
2018-12-15 03:05:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 03:05:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:05:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:05:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:05:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:05:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:05:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:05:22 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-15 03:05:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 03:05:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 03:05:54 [DEBUG   ] Got command RPT from MCS: ref #841187
2018-12-15 03:05:54 [DEBUG   ] summary = ERROR
2018-12-15 03:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841187  13 58467 11154781 A  ERRORERROR'
2018-12-15 03:05:54 [DEBUG   ] Got command RPT from MCS: ref #841188
2018-12-15 03:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841188  77 58467 11154782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:06:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 03:06:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:06:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:06:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:06:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:06:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:06:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:06:22 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-12-15 03:06:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 03:06:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 03:07:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 03:07:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:07:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:07:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:07:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:07:22 [WARNING ] (13, 1, 'bot')
2018-12-15 03:07:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:07:22 [DEBUG   ] Finished updating board flags in 1.539 seconds
2018-12-15 03:07:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 03:07:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 03:08:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 03:08:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 03:08:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:08:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:08:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:08:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:08:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:08:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:08:23 [DEBUG   ] Finished updating board flags in 2.161 seconds
2018-12-15 03:08:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:08:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:09:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 03:09:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:09:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:09:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:09:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:09:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:09:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:09:23 [DEBUG   ] Finished updating board flags in 1.910 seconds
2018-12-15 03:09:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 03:09:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:10:10 [DEBUG   ] Got command RPT from MCS: ref #841210
2018-12-15 03:10:10 [DEBUG   ] summary = ERROR
2018-12-15 03:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841210  13 58467 11410113 A  ERRORERROR'
2018-12-15 03:10:10 [DEBUG   ] Got command RPT from MCS: ref #841211
2018-12-15 03:10:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841211  77 58467 11410318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:10:10 [DEBUG   ] Got command RPT from MCS: ref #841212
2018-12-15 03:10:10 [DEBUG   ] summary = ERROR
2018-12-15 03:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841212  13 58467 11410521 A  ERRORERROR'
2018-12-15 03:10:10 [DEBUG   ] Got command RPT from MCS: ref #841214
2018-12-15 03:10:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841214  77 58467 11410725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:10:10 [DEBUG   ] Got command RPT from MCS: ref #841216
2018-12-15 03:10:10 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841216  12 58467 11410918 A  ERRORB–™š'
2018-12-15 03:10:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:10:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 03:10:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:10:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:10:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:10:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:10:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:10:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:10:23 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-15 03:10:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 03:10:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 03:10:54 [DEBUG   ] Got command RPT from MCS: ref #841220
2018-12-15 03:10:54 [DEBUG   ] summary = ERROR
2018-12-15 03:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841220  13 58467 11454781 A  ERRORERROR'
2018-12-15 03:10:54 [DEBUG   ] Got command RPT from MCS: ref #841221
2018-12-15 03:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841221  77 58467 11454782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:11:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:11:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:11:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:11:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:11:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:11:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:11:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:11:23 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-12-15 03:11:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:11:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 03:12:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 03:12:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 03:12:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:12:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:12:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:12:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:12:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:12:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:12:23 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-15 03:12:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:12:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:13:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 03:13:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:13:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:13:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:13:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:13:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:13:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:13:23 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-15 03:13:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 03:13:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 03:14:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 03:14:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:14:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 03:14:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:14:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:14:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:14:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:14:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:14:23 [DEBUG   ] Finished updating board flags in 1.756 seconds
2018-12-15 03:14:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 03:14:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:15:10 [DEBUG   ] Got command RPT from MCS: ref #841245
2018-12-15 03:15:10 [DEBUG   ] summary = ERROR
2018-12-15 03:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841245  13 58467 11710201 A  ERRORERROR'
2018-12-15 03:15:10 [DEBUG   ] Got command RPT from MCS: ref #841246
2018-12-15 03:15:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841246  77 58467 11710405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:15:10 [DEBUG   ] Got command RPT from MCS: ref #841247
2018-12-15 03:15:10 [DEBUG   ] summary = ERROR
2018-12-15 03:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841247  13 58467 11710597 A  ERRORERROR'
2018-12-15 03:15:10 [DEBUG   ] Got command RPT from MCS: ref #841248
2018-12-15 03:15:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841248  77 58467 11710801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:15:11 [DEBUG   ] Got command RPT from MCS: ref #841249
2018-12-15 03:15:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841249  12 58467 11711005 A  ERRORB—™š'
2018-12-15 03:15:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 03:15:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:15:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 03:15:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:15:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:15:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:15:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:15:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:15:23 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-15 03:15:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 03:15:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:15:54 [DEBUG   ] Got command RPT from MCS: ref #841250
2018-12-15 03:15:54 [DEBUG   ] summary = ERROR
2018-12-15 03:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841250  13 58467 11754777 A  ERRORERROR'
2018-12-15 03:15:54 [DEBUG   ] Got command RPT from MCS: ref #841251
2018-12-15 03:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841251  77 58467 11754778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:16:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:16:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:16:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 03:16:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:16:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:16:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:16:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:16:23 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-12-15 03:16:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:16:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 03:17:14 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-15 03:17:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:17:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:17:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:17:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:17:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:17:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:17:23 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-12-15 03:17:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 03:17:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 03:18:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 03:18:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:18:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:18:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:18:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:18:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:18:23 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-12-15 03:18:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:18:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:19:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 03:19:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:19:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:19:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:19:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:19:23 [WARNING ] (13, 1, 'bot')
2018-12-15 03:19:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:19:23 [DEBUG   ] Finished updating board flags in 1.526 seconds
2018-12-15 03:19:34 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-12-15 03:19:54 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-15 03:20:10 [DEBUG   ] Got command RPT from MCS: ref #841273
2018-12-15 03:20:10 [DEBUG   ] summary = ERROR
2018-12-15 03:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841273  13 58467 12010281 A  ERRORERROR'
2018-12-15 03:20:10 [DEBUG   ] Got command RPT from MCS: ref #841274
2018-12-15 03:20:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841274  77 58467 12010485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:20:10 [DEBUG   ] Got command RPT from MCS: ref #841275
2018-12-15 03:20:10 [DEBUG   ] summary = ERROR
2018-12-15 03:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841275  13 58467 12010677 A  ERRORERROR'
2018-12-15 03:20:10 [DEBUG   ] Got command RPT from MCS: ref #841277
2018-12-15 03:20:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:20:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841277  77 58467 12010881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:20:11 [DEBUG   ] Got command RPT from MCS: ref #841279
2018-12-15 03:20:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841279  12 58467 12011086 A  ERRORB•™š'
2018-12-15 03:20:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 03:20:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:20:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:20:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:20:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:20:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:20:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:20:24 [DEBUG   ] Finished updating board flags in 2.192 seconds
2018-12-15 03:20:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 03:20:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 03:20:54 [DEBUG   ] Got command RPT from MCS: ref #841287
2018-12-15 03:20:54 [DEBUG   ] summary = ERROR
2018-12-15 03:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841287  13 58467 12054785 A  ERRORERROR'
2018-12-15 03:20:54 [DEBUG   ] Got command RPT from MCS: ref #841288
2018-12-15 03:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841288  77 58467 12054786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:21:14 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-12-15 03:21:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:21:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:21:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:21:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:21:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:21:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:21:24 [DEBUG   ] Finished updating board flags in 1.896 seconds
2018-12-15 03:21:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 03:21:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 03:22:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-15 03:22:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 03:22:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:22:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:22:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:22:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:22:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:22:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:22:24 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-15 03:22:34 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-15 03:22:55 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-15 03:23:15 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-12-15 03:23:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:23:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:23:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:23:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:23:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:23:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:23:24 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-12-15 03:23:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-15 03:23:55 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-15 03:24:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 03:24:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:24:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:24:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:24:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:24:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:24:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:24:24 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-12-15 03:24:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 03:24:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 03:25:10 [DEBUG   ] Got command RPT from MCS: ref #841308
2018-12-15 03:25:10 [DEBUG   ] summary = ERROR
2018-12-15 03:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841308  13 58467 12310361 A  ERRORERROR'
2018-12-15 03:25:10 [DEBUG   ] Got command RPT from MCS: ref #841309
2018-12-15 03:25:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841309  77 58467 12310565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:25:10 [DEBUG   ] Got command RPT from MCS: ref #841310
2018-12-15 03:25:10 [DEBUG   ] summary = ERROR
2018-12-15 03:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841310  13 58467 12310757 A  ERRORERROR'
2018-12-15 03:25:10 [DEBUG   ] Got command RPT from MCS: ref #841311
2018-12-15 03:25:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841311  77 58467 12310961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:25:11 [DEBUG   ] Got command RPT from MCS: ref #841312
2018-12-15 03:25:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841312  12 58467 12311165 A  ERRORB–™š'
2018-12-15 03:25:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:25:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 03:25:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:25:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:25:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:25:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:25:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:25:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:25:24 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-12-15 03:25:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 03:25:54 [DEBUG   ] Got command RPT from MCS: ref #841313
2018-12-15 03:25:54 [DEBUG   ] summary = ERROR
2018-12-15 03:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841313  13 58467 12354781 A  ERRORERROR'
2018-12-15 03:25:54 [DEBUG   ] Got command RPT from MCS: ref #841314
2018-12-15 03:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841314  77 58467 12354782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:25:55 [DEBUG   ] Finished updating ant stats in 0.735 seconds
2018-12-15 03:26:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:26:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:26:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:26:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:26:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:26:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:26:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:26:24 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-12-15 03:26:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:26:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-15 03:27:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 03:27:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 03:27:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:27:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:27:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:27:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:27:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:27:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:27:24 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-12-15 03:27:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 03:27:56 [DEBUG   ] Finished updating ant stats in 1.304 seconds
2018-12-15 03:28:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 03:28:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:28:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:28:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:28:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:28:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:28:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:28:24 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-12-15 03:28:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:28:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:29:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:29:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 03:29:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:29:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:29:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:29:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:29:24 [WARNING ] (13, 1, 'bot')
2018-12-15 03:29:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:29:24 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-12-15 03:29:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:29:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:30:10 [DEBUG   ] Got command RPT from MCS: ref #841340
2018-12-15 03:30:10 [DEBUG   ] summary = ERROR
2018-12-15 03:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841340  13 58467 12610445 A  ERRORERROR'
2018-12-15 03:30:10 [DEBUG   ] Got command RPT from MCS: ref #841341
2018-12-15 03:30:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841341  77 58467 12610637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:30:10 [DEBUG   ] Got command RPT from MCS: ref #841342
2018-12-15 03:30:10 [DEBUG   ] summary = ERROR
2018-12-15 03:30:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841342  13 58467 12610841 A  ERRORERROR'
2018-12-15 03:30:11 [DEBUG   ] Got command RPT from MCS: ref #841344
2018-12-15 03:30:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841344  77 58467 12611045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:30:11 [DEBUG   ] Got command RPT from MCS: ref #841345
2018-12-15 03:30:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841345  12 58467 12611241 A  ERRORB—™š'
2018-12-15 03:30:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:30:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:30:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:30:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:30:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:30:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:30:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:30:25 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-12-15 03:30:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 03:30:54 [DEBUG   ] Got command RPT from MCS: ref #841350
2018-12-15 03:30:54 [DEBUG   ] summary = ERROR
2018-12-15 03:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841350  13 58467 12654785 A  ERRORERROR'
2018-12-15 03:30:54 [DEBUG   ] Got command RPT from MCS: ref #841351
2018-12-15 03:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841351  77 58467 12654786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:30:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:31:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:31:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:31:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:31:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:31:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:31:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:31:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:31:25 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-12-15 03:31:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:31:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 03:32:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 03:32:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:32:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:32:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:32:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:32:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:32:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:32:25 [DEBUG   ] Finished updating board flags in 1.838 seconds
2018-12-15 03:32:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:32:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:33:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 03:33:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:33:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:33:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:33:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:33:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:33:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:33:25 [DEBUG   ] Finished updating board flags in 1.726 seconds
2018-12-15 03:33:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 03:33:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:34:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:34:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:34:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:34:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:34:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:34:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:34:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:34:25 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-12-15 03:34:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 03:34:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 03:35:10 [DEBUG   ] Got command RPT from MCS: ref #841371
2018-12-15 03:35:10 [DEBUG   ] summary = ERROR
2018-12-15 03:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841371  13 58467 12910521 A  ERRORERROR'
2018-12-15 03:35:10 [DEBUG   ] Got command RPT from MCS: ref #841372
2018-12-15 03:35:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841372  77 58467 12910725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:35:10 [DEBUG   ] Got command RPT from MCS: ref #841373
2018-12-15 03:35:10 [DEBUG   ] summary = ERROR
2018-12-15 03:35:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841373  13 58467 12910918 A  ERRORERROR'
2018-12-15 03:35:11 [DEBUG   ] Got command RPT from MCS: ref #841374
2018-12-15 03:35:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841374  77 58467 12911121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:35:11 [DEBUG   ] Got command RPT from MCS: ref #841375
2018-12-15 03:35:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841375  12 58467 12911325 A  ERRORB–™š'
2018-12-15 03:35:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:35:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:35:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:35:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:35:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:35:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:35:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:35:25 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-12-15 03:35:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 03:35:54 [DEBUG   ] Got command RPT from MCS: ref #841380
2018-12-15 03:35:54 [DEBUG   ] summary = ERROR
2018-12-15 03:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841380  13 58467 12954778 A  ERRORERROR'
2018-12-15 03:35:54 [DEBUG   ] Got command RPT from MCS: ref #841381
2018-12-15 03:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841381  77 58467 12954778 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:35:57 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-12-15 03:36:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 03:36:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:36:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:36:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:36:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:36:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:36:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:36:25 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-15 03:36:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 03:36:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 03:37:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 03:37:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:37:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:37:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:37:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:37:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:37:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:37:25 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-12-15 03:37:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:37:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:38:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:38:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:38:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:38:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:38:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:38:25 [WARNING ] (13, 1, 'bot')
2018-12-15 03:38:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:38:25 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-12-15 03:38:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:38:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:39:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:39:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:39:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 03:39:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:39:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:39:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:39:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:39:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:39:26 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-12-15 03:39:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:39:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:40:10 [DEBUG   ] Got command RPT from MCS: ref #841403
2018-12-15 03:40:10 [DEBUG   ] summary = ERROR
2018-12-15 03:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841403  13 58467 13210605 A  ERRORERROR'
2018-12-15 03:40:10 [DEBUG   ] Got command RPT from MCS: ref #841404
2018-12-15 03:40:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841404  77 58467 13210801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:40:11 [DEBUG   ] Got command RPT from MCS: ref #841405
2018-12-15 03:40:11 [DEBUG   ] summary = ERROR
2018-12-15 03:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841405  13 58467 13211005 A  ERRORERROR'
2018-12-15 03:40:11 [DEBUG   ] Got command RPT from MCS: ref #841407
2018-12-15 03:40:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841407  77 58467 13211210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:40:11 [DEBUG   ] Got command RPT from MCS: ref #841408
2018-12-15 03:40:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841408  12 58467 13211401 A  ERRORB–™š'
2018-12-15 03:40:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:40:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 03:40:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:40:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:40:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:40:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:40:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:40:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:40:26 [DEBUG   ] Finished updating board flags in 2.059 seconds
2018-12-15 03:40:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:40:54 [DEBUG   ] Got command RPT from MCS: ref #841413
2018-12-15 03:40:54 [DEBUG   ] summary = ERROR
2018-12-15 03:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841413  13 58467 13254781 A  ERRORERROR'
2018-12-15 03:40:54 [DEBUG   ] Got command RPT from MCS: ref #841414
2018-12-15 03:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841414  77 58467 13254782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:40:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 03:41:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 03:41:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:41:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:41:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:41:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:41:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:41:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:41:26 [DEBUG   ] Finished updating board flags in 1.930 seconds
2018-12-15 03:41:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 03:41:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:42:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 03:42:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:42:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:42:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:42:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:42:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:42:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:42:26 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-15 03:42:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 03:42:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:43:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 03:43:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:43:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:43:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:43:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:43:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:43:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:43:26 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-15 03:43:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 03:43:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 03:44:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 03:44:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 03:44:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:44:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:44:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:44:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:44:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:44:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:44:26 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-12-15 03:44:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:44:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 03:45:10 [DEBUG   ] Got command RPT from MCS: ref #841438
2018-12-15 03:45:10 [DEBUG   ] summary = ERROR
2018-12-15 03:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841438  13 58467 13510677 A  ERRORERROR'
2018-12-15 03:45:10 [DEBUG   ] Got command RPT from MCS: ref #841439
2018-12-15 03:45:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:45:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841439  77 58467 13510881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:45:11 [DEBUG   ] Got command RPT from MCS: ref #841440
2018-12-15 03:45:11 [DEBUG   ] summary = ERROR
2018-12-15 03:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841440  13 58467 13511085 A  ERRORERROR'
2018-12-15 03:45:11 [DEBUG   ] Got command RPT from MCS: ref #841441
2018-12-15 03:45:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841441  77 58467 13511277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:45:11 [DEBUG   ] Got command RPT from MCS: ref #841442
2018-12-15 03:45:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841442  12 58467 13511481 A  ERRORB—™š'
2018-12-15 03:45:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 03:45:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:45:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:45:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:45:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:45:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:45:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:45:26 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-15 03:45:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 03:45:54 [DEBUG   ] Got command RPT from MCS: ref #841443
2018-12-15 03:45:54 [DEBUG   ] summary = ERROR
2018-12-15 03:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841443  13 58467 13554781 A  ERRORERROR'
2018-12-15 03:45:54 [DEBUG   ] Got command RPT from MCS: ref #841444
2018-12-15 03:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841444  77 58467 13554782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:45:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 03:46:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 03:46:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:46:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:46:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:46:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:46:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:46:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:46:26 [DEBUG   ] Finished updating board flags in 1.742 seconds
2018-12-15 03:46:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 03:46:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 03:47:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 03:47:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:47:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 03:47:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:47:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:47:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:47:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:47:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:47:26 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-15 03:47:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:47:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 03:48:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 03:48:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:48:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:48:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:48:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:48:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:48:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:48:26 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-12-15 03:48:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 03:48:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:49:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 03:49:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:49:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 03:49:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:49:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:49:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:49:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:49:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:49:26 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-12-15 03:49:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 03:49:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 03:50:10 [DEBUG   ] Got command RPT from MCS: ref #841466
2018-12-15 03:50:10 [DEBUG   ] summary = ERROR
2018-12-15 03:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841466  13 58467 13810757 A  ERRORERROR'
2018-12-15 03:50:10 [DEBUG   ] Got command RPT from MCS: ref #841467
2018-12-15 03:50:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:50:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841467  77 58467 13810961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:50:11 [DEBUG   ] Got command RPT from MCS: ref #841468
2018-12-15 03:50:11 [DEBUG   ] summary = ERROR
2018-12-15 03:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841468  13 58467 13811165 A  ERRORERROR'
2018-12-15 03:50:11 [DEBUG   ] Got command RPT from MCS: ref #841470
2018-12-15 03:50:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841470  77 58467 13811369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:50:11 [DEBUG   ] Got command RPT from MCS: ref #841471
2018-12-15 03:50:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841471  12 58467 13811561 A  ERRORB–™š'
2018-12-15 03:50:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 03:50:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:50:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:50:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:50:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:50:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:50:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:50:26 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-12-15 03:50:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:50:54 [DEBUG   ] Got command RPT from MCS: ref #841480
2018-12-15 03:50:54 [DEBUG   ] summary = ERROR
2018-12-15 03:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841480  13 58467 13854785 A  ERRORERROR'
2018-12-15 03:50:54 [DEBUG   ] Got command RPT from MCS: ref #841481
2018-12-15 03:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841481  77 58467 13854786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:50:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 03:51:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 03:51:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:51:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:51:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:51:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:51:26 [WARNING ] (13, 1, 'bot')
2018-12-15 03:51:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:51:26 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-12-15 03:51:38 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2018-12-15 03:51:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 03:52:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 03:52:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:52:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:52:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:52:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:52:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:52:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:52:27 [DEBUG   ] Finished updating board flags in 2.210 seconds
2018-12-15 03:52:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 03:52:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 03:53:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 03:53:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:53:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:53:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:53:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:53:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:53:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:53:27 [DEBUG   ] Finished updating board flags in 2.142 seconds
2018-12-15 03:53:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 03:53:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 03:54:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 03:54:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:54:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:54:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:54:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:54:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:54:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:54:27 [DEBUG   ] Finished updating board flags in 2.031 seconds
2018-12-15 03:54:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 03:54:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 03:55:10 [DEBUG   ] Got command RPT from MCS: ref #841501
2018-12-15 03:55:10 [DEBUG   ] summary = ERROR
2018-12-15 03:55:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841501  13 58467 14110845 A  ERRORERROR'
2018-12-15 03:55:11 [DEBUG   ] Got command RPT from MCS: ref #841502
2018-12-15 03:55:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841502  77 58467 14111049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:55:11 [DEBUG   ] Got command RPT from MCS: ref #841503
2018-12-15 03:55:11 [DEBUG   ] summary = ERROR
2018-12-15 03:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841503  13 58467 14111241 A  ERRORERROR'
2018-12-15 03:55:11 [DEBUG   ] Got command RPT from MCS: ref #841504
2018-12-15 03:55:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841504  77 58467 14111445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:55:11 [DEBUG   ] Got command RPT from MCS: ref #841505
2018-12-15 03:55:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 03:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841505  12 58467 14111649 A  ERRORB•™š'
2018-12-15 03:55:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 03:55:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:55:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:55:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:55:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:55:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:55:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:55:27 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-12-15 03:55:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:55:54 [DEBUG   ] Got command RPT from MCS: ref #841506
2018-12-15 03:55:54 [DEBUG   ] summary = ERROR
2018-12-15 03:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841506  13 58467 14154785 A  ERRORERROR'
2018-12-15 03:55:54 [DEBUG   ] Got command RPT from MCS: ref #841507
2018-12-15 03:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 03:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841507  77 58467 14154786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 03:55:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 03:56:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:56:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:56:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:56:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:56:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:56:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:56:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:56:27 [DEBUG   ] Finished updating board flags in 2.048 seconds
2018-12-15 03:56:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 03:56:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 03:57:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 03:57:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:57:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:57:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:57:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:57:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:57:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:57:27 [DEBUG   ] Finished updating board flags in 1.926 seconds
2018-12-15 03:57:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 03:57:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 03:58:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 03:58:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:58:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:58:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:58:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:58:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:58:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:58:27 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-12-15 03:58:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 03:58:59 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 03:59:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 03:59:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 03:59:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:59:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:59:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:59:27 [WARNING ] (13, 1, 'bot')
2018-12-15 03:59:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 03:59:27 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-12-15 03:59:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 03:59:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-15 04:00:10 [DEBUG   ] Got command RPT from MCS: ref #841533
2018-12-15 04:00:10 [DEBUG   ] summary = ERROR
2018-12-15 04:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841533  13 58467 14410921 A  ERRORERROR'
2018-12-15 04:00:11 [DEBUG   ] Got command RPT from MCS: ref #841534
2018-12-15 04:00:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841534  77 58467 14411125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:00:11 [DEBUG   ] Got command RPT from MCS: ref #841535
2018-12-15 04:00:11 [DEBUG   ] summary = ERROR
2018-12-15 04:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841535  13 58467 14411329 A  ERRORERROR'
2018-12-15 04:00:11 [DEBUG   ] Got command RPT from MCS: ref #841537
2018-12-15 04:00:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841537  77 58467 14411521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:00:11 [DEBUG   ] Got command RPT from MCS: ref #841538
2018-12-15 04:00:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841538  12 58467 14411725 A  ERRORB–™š'
2018-12-15 04:00:20 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 04:00:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:00:27 [WARNING ] (13, 1, 'bot')
2018-12-15 04:00:27 [WARNING ] (13, 1, 'bot')
2018-12-15 04:00:27 [WARNING ] (13, 1, 'bot')
2018-12-15 04:00:27 [WARNING ] (13, 1, 'bot')
2018-12-15 04:00:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:00:27 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-12-15 04:00:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:00:54 [DEBUG   ] Got command RPT from MCS: ref #841543
2018-12-15 04:00:54 [DEBUG   ] summary = ERROR
2018-12-15 04:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841543  13 58467 14454785 A  ERRORERROR'
2018-12-15 04:00:54 [DEBUG   ] Got command RPT from MCS: ref #841544
2018-12-15 04:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841544  77 58467 14454786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:01:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 04:01:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:01:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:01:27 [WARNING ] (13, 1, 'bot')
2018-12-15 04:01:27 [WARNING ] (13, 1, 'bot')
2018-12-15 04:01:27 [WARNING ] (13, 1, 'bot')
2018-12-15 04:01:27 [WARNING ] (13, 1, 'bot')
2018-12-15 04:01:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:01:27 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-12-15 04:01:40 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-12-15 04:02:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:02:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 04:02:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:02:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 04:02:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:02:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:02:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:02:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:02:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:02:28 [DEBUG   ] Finished updating board flags in 2.207 seconds
2018-12-15 04:02:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 04:03:00 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 04:03:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 04:03:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:03:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:03:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:03:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:03:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:03:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:03:28 [DEBUG   ] Finished updating board flags in 2.185 seconds
2018-12-15 04:03:41 [DEBUG   ] Finished updating ant stats in 1.186 seconds
2018-12-15 04:04:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:04:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:04:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:04:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 04:04:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 04:04:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:04:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:04:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:04:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:04:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:04:28 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-12-15 04:04:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 04:05:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 04:05:10 [DEBUG   ] Got command RPT from MCS: ref #841564
2018-12-15 04:05:10 [DEBUG   ] summary = ERROR
2018-12-15 04:05:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841564  13 58467 14710997 A  ERRORERROR'
2018-12-15 04:05:11 [DEBUG   ] Got command RPT from MCS: ref #841565
2018-12-15 04:05:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841565  77 58467 14711201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:05:11 [DEBUG   ] Got command RPT from MCS: ref #841566
2018-12-15 04:05:11 [DEBUG   ] summary = ERROR
2018-12-15 04:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841566  13 58467 14711405 A  ERRORERROR'
2018-12-15 04:05:11 [DEBUG   ] Got command RPT from MCS: ref #841567
2018-12-15 04:05:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841567  77 58467 14711609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:05:11 [DEBUG   ] Got command RPT from MCS: ref #841568
2018-12-15 04:05:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841568  12 58467 14711801 A  ERRORB—™š'
2018-12-15 04:05:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:05:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:05:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 04:05:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:05:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:05:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:05:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:05:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:05:28 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-12-15 04:05:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:05:54 [DEBUG   ] Got command RPT from MCS: ref #841573
2018-12-15 04:05:54 [DEBUG   ] summary = ERROR
2018-12-15 04:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841573  13 58467 14754785 A  ERRORERROR'
2018-12-15 04:05:54 [DEBUG   ] Got command RPT from MCS: ref #841574
2018-12-15 04:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841574  77 58467 14754786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:06:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 04:06:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 04:06:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:06:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:06:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:06:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:06:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:06:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:06:28 [DEBUG   ] Finished updating board flags in 1.880 seconds
2018-12-15 04:06:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:07:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 04:07:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 04:07:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:07:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:07:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:07:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:07:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:07:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:07:28 [DEBUG   ] Finished updating board flags in 1.735 seconds
2018-12-15 04:07:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 04:08:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:08:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:08:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:08:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 04:08:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:08:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:08:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:08:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:08:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:08:28 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-15 04:08:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 04:09:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 04:09:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 04:09:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:09:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:09:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:09:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:09:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:09:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:09:28 [DEBUG   ] Finished updating board flags in 1.660 seconds
2018-12-15 04:09:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 04:10:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 04:10:11 [DEBUG   ] Got command RPT from MCS: ref #841596
2018-12-15 04:10:11 [DEBUG   ] summary = ERROR
2018-12-15 04:10:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841596  13 58467 15011081 A  ERRORERROR'
2018-12-15 04:10:11 [DEBUG   ] Got command RPT from MCS: ref #841597
2018-12-15 04:10:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:10:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841597  77 58467 15011285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:10:11 [DEBUG   ] Got command RPT from MCS: ref #841598
2018-12-15 04:10:11 [DEBUG   ] summary = ERROR
2018-12-15 04:10:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841598  13 58467 15011482 A  ERRORERROR'
2018-12-15 04:10:11 [DEBUG   ] Got command RPT from MCS: ref #841600
2018-12-15 04:10:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:10:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841600  77 58467 15011686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:10:11 [DEBUG   ] Got command RPT from MCS: ref #841602
2018-12-15 04:10:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:10:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841602  12 58467 15011889 A  ERRORB–™š'
2018-12-15 04:10:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 04:10:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:10:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 04:10:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:10:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:10:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:10:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:10:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:10:28 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-12-15 04:10:42 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 04:10:54 [DEBUG   ] Got command RPT from MCS: ref #841606
2018-12-15 04:10:54 [DEBUG   ] summary = ERROR
2018-12-15 04:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841606  13 58467 15054786 A  ERRORERROR'
2018-12-15 04:10:54 [DEBUG   ] Got command RPT from MCS: ref #841607
2018-12-15 04:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841607  77 58467 15054786 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:11:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 04:11:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 04:11:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 04:11:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:11:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 04:11:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:11:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:11:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:11:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:11:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:11:28 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-15 04:11:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:12:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 04:12:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 04:12:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:12:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-12-15 04:12:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:12:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:12:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:12:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:12:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:12:28 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-12-15 04:12:42 [DEBUG   ] Finished updating ant stats in 0.989 seconds
2018-12-15 04:13:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:13:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:13:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:13:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 04:13:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:13:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:13:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:13:28 [WARNING ] (13, 1, 'bot')
2018-12-15 04:13:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:13:28 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-12-15 04:13:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 04:14:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:14:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:14:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:14:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:14:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:14:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:14:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:14:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:14:29 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-12-15 04:14:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:15:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:15:11 [DEBUG   ] Got command RPT from MCS: ref #841631
2018-12-15 04:15:11 [DEBUG   ] summary = ERROR
2018-12-15 04:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841631  13 58467 15311161 A  ERRORERROR'
2018-12-15 04:15:11 [DEBUG   ] Got command RPT from MCS: ref #841632
2018-12-15 04:15:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841632  77 58467 15311365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:15:11 [DEBUG   ] Got command RPT from MCS: ref #841633
2018-12-15 04:15:11 [DEBUG   ] summary = ERROR
2018-12-15 04:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841633  13 58467 15311569 A  ERRORERROR'
2018-12-15 04:15:11 [DEBUG   ] Got command RPT from MCS: ref #841634
2018-12-15 04:15:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841634  77 58467 15311761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:15:11 [DEBUG   ] Got command RPT from MCS: ref #841635
2018-12-15 04:15:11 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:15:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841635  12 58467 15311965 A  ERRORB—™š'
2018-12-15 04:15:22 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-15 04:15:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:15:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:15:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:15:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:15:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:15:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:15:29 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-12-15 04:15:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:15:54 [DEBUG   ] Got command RPT from MCS: ref #841636
2018-12-15 04:15:54 [DEBUG   ] summary = ERROR
2018-12-15 04:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841636  13 58467 15354789 A  ERRORERROR'
2018-12-15 04:15:54 [DEBUG   ] Got command RPT from MCS: ref #841637
2018-12-15 04:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841637  77 58467 15354790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:16:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 04:16:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 04:16:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:16:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:16:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:16:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:16:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:16:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:16:29 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-15 04:16:42 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-15 04:17:03 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-12-15 04:17:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 04:17:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:17:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:17:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:17:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:17:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:17:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:17:29 [DEBUG   ] Finished updating board flags in 1.752 seconds
2018-12-15 04:17:42 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-15 04:18:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 04:18:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 04:18:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 04:18:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:18:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:18:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:18:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:18:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:18:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:18:29 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-12-15 04:18:43 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 04:19:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 04:19:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 04:19:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:19:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:19:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:19:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:19:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:19:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:19:29 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-12-15 04:19:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 04:20:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:20:11 [DEBUG   ] Got command RPT from MCS: ref #841659
2018-12-15 04:20:11 [DEBUG   ] summary = ERROR
2018-12-15 04:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841659  13 58467 15611237 A  ERRORERROR'
2018-12-15 04:20:11 [DEBUG   ] Got command RPT from MCS: ref #841660
2018-12-15 04:20:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841660  77 58467 15611441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:20:11 [DEBUG   ] Got command RPT from MCS: ref #841661
2018-12-15 04:20:11 [DEBUG   ] summary = ERROR
2018-12-15 04:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841661  13 58467 15611645 A  ERRORERROR'
2018-12-15 04:20:11 [DEBUG   ] Got command RPT from MCS: ref #841663
2018-12-15 04:20:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841663  77 58467 15611849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:20:12 [DEBUG   ] Got command RPT from MCS: ref #841665
2018-12-15 04:20:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841665  12 58467 15612041 A  ERRORB—™š'
2018-12-15 04:20:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 04:20:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 04:20:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:20:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:20:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:20:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:20:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:20:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:20:29 [DEBUG   ] Finished updating board flags in 1.487 seconds
2018-12-15 04:20:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:20:54 [DEBUG   ] Got command RPT from MCS: ref #841673
2018-12-15 04:20:54 [DEBUG   ] summary = ERROR
2018-12-15 04:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841673  13 58467 15654789 A  ERRORERROR'
2018-12-15 04:20:54 [DEBUG   ] Got command RPT from MCS: ref #841674
2018-12-15 04:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841674  77 58467 15654790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:21:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 04:21:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:21:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:21:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:21:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:21:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:21:29 [WARNING ] (13, 1, 'bot')
2018-12-15 04:21:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:21:29 [DEBUG   ] Finished updating board flags in 1.526 seconds
2018-12-15 04:21:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:22:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 04:22:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 04:22:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:22:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 04:22:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:22:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:22:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:22:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:22:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:22:30 [DEBUG   ] Finished updating board flags in 1.556 seconds
2018-12-15 04:22:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:23:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 04:23:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:23:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 04:23:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:23:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:23:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:23:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:23:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:23:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:23:30 [DEBUG   ] Finished updating board flags in 2.148 seconds
2018-12-15 04:23:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 04:24:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:24:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 04:24:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:24:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 04:24:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:24:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:24:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:24:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:24:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:24:30 [DEBUG   ] Finished updating board flags in 2.022 seconds
2018-12-15 04:24:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 04:25:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 04:25:11 [DEBUG   ] Got command RPT from MCS: ref #841694
2018-12-15 04:25:11 [DEBUG   ] summary = ERROR
2018-12-15 04:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841694  13 58467 15911329 A  ERRORERROR'
2018-12-15 04:25:11 [DEBUG   ] Got command RPT from MCS: ref #841695
2018-12-15 04:25:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841695  77 58467 15911521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:25:11 [DEBUG   ] Got command RPT from MCS: ref #841696
2018-12-15 04:25:11 [DEBUG   ] summary = ERROR
2018-12-15 04:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841696  13 58467 15911725 A  ERRORERROR'
2018-12-15 04:25:11 [DEBUG   ] Got command RPT from MCS: ref #841697
2018-12-15 04:25:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:25:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841697  77 58467 15911929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:25:12 [DEBUG   ] Got command RPT from MCS: ref #841698
2018-12-15 04:25:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841698  12 58467 15912133 A  ERRORB—™š'
2018-12-15 04:25:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 04:25:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:25:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:25:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:25:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:25:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:25:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:25:30 [DEBUG   ] Finished updating board flags in 1.879 seconds
2018-12-15 04:25:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:25:54 [DEBUG   ] Got command RPT from MCS: ref #841699
2018-12-15 04:25:54 [DEBUG   ] summary = ERROR
2018-12-15 04:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841699  13 58467 15954789 A  ERRORERROR'
2018-12-15 04:25:54 [DEBUG   ] Got command RPT from MCS: ref #841700
2018-12-15 04:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841700  77 58467 15954790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:26:03 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 04:26:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:26:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 04:26:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:26:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:26:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:26:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:26:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:26:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:26:30 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-12-15 04:26:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:27:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 04:27:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:27:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:27:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:27:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:27:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:27:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:27:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:27:30 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-15 04:27:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:28:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:28:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 04:28:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:28:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 04:28:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:28:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:28:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:28:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:28:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:28:30 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-12-15 04:28:43 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-15 04:29:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 04:29:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:29:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 04:29:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:29:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:29:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:29:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:29:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:29:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:29:30 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-12-15 04:29:43 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-15 04:30:04 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 04:30:11 [DEBUG   ] Got command RPT from MCS: ref #841726
2018-12-15 04:30:11 [DEBUG   ] summary = ERROR
2018-12-15 04:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841726  13 58467 16211405 A  ERRORERROR'
2018-12-15 04:30:11 [DEBUG   ] Got command RPT from MCS: ref #841727
2018-12-15 04:30:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841727  77 58467 16211609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:30:11 [DEBUG   ] Got command RPT from MCS: ref #841728
2018-12-15 04:30:11 [DEBUG   ] summary = ERROR
2018-12-15 04:30:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841728  13 58467 16211801 A  ERRORERROR'
2018-12-15 04:30:12 [DEBUG   ] Got command RPT from MCS: ref #841730
2018-12-15 04:30:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841730  77 58467 16212005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:30:12 [DEBUG   ] Got command RPT from MCS: ref #841732
2018-12-15 04:30:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841732  12 58467 16212209 A  ERRORB˜™š'
2018-12-15 04:30:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 04:30:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:30:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:30:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:30:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:30:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:30:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:30:30 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-15 04:30:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:30:54 [DEBUG   ] Got command RPT from MCS: ref #841736
2018-12-15 04:30:54 [DEBUG   ] summary = ERROR
2018-12-15 04:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841736  13 58467 16254793 A  ERRORERROR'
2018-12-15 04:30:54 [DEBUG   ] Got command RPT from MCS: ref #841737
2018-12-15 04:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841737  77 58467 16254794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:31:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:31:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 04:31:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:31:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:31:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:31:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:31:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:31:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:31:30 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-12-15 04:31:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 04:32:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 04:32:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 04:32:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:32:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:32:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:32:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:32:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:32:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:32:30 [DEBUG   ] Finished updating board flags in 1.405 seconds
2018-12-15 04:32:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 04:33:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:33:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:33:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:33:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:33:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:33:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:33:30 [WARNING ] (13, 1, 'bot')
2018-12-15 04:33:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:33:30 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-12-15 04:33:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:34:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 04:34:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:34:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:34:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:34:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:34:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:34:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:34:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:34:31 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-12-15 04:34:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:35:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 04:35:11 [DEBUG   ] Got command RPT from MCS: ref #841757
2018-12-15 04:35:11 [DEBUG   ] summary = ERROR
2018-12-15 04:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841757  13 58467 16511485 A  ERRORERROR'
2018-12-15 04:35:11 [DEBUG   ] Got command RPT from MCS: ref #841758
2018-12-15 04:35:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841758  77 58467 16511689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:35:11 [DEBUG   ] Got command RPT from MCS: ref #841759
2018-12-15 04:35:11 [DEBUG   ] summary = ERROR
2018-12-15 04:35:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841759  13 58467 16511881 A  ERRORERROR'
2018-12-15 04:35:12 [DEBUG   ] Got command RPT from MCS: ref #841760
2018-12-15 04:35:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841760  77 58467 16512085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:35:12 [DEBUG   ] Got command RPT from MCS: ref #841761
2018-12-15 04:35:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841761  12 58467 16512289 A  ERRORB˜™š'
2018-12-15 04:35:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 04:35:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:35:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:35:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:35:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:35:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:35:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:35:31 [DEBUG   ] Finished updating board flags in 2.148 seconds
2018-12-15 04:35:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:35:54 [DEBUG   ] Got command RPT from MCS: ref #841766
2018-12-15 04:35:54 [DEBUG   ] summary = ERROR
2018-12-15 04:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841766  13 58467 16554789 A  ERRORERROR'
2018-12-15 04:35:54 [DEBUG   ] Got command RPT from MCS: ref #841767
2018-12-15 04:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841767  77 58467 16554790 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:36:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:36:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 04:36:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 04:36:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:36:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:36:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:36:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:36:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:36:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:36:31 [DEBUG   ] Finished updating board flags in 1.891 seconds
2018-12-15 04:36:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:37:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:37:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 04:37:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:37:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:37:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:37:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:37:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:37:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:37:31 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-12-15 04:37:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 04:38:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:38:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:38:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:38:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:38:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:38:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:38:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:38:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:38:31 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-12-15 04:38:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:39:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:39:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 04:39:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:39:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:39:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:39:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:39:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:39:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:39:31 [DEBUG   ] Finished updating board flags in 1.766 seconds
2018-12-15 04:39:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:40:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 04:40:11 [DEBUG   ] Got command RPT from MCS: ref #841789
2018-12-15 04:40:11 [DEBUG   ] summary = ERROR
2018-12-15 04:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841789  13 58467 16811569 A  ERRORERROR'
2018-12-15 04:40:11 [DEBUG   ] Got command RPT from MCS: ref #841790
2018-12-15 04:40:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841790  77 58467 16811761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:40:11 [DEBUG   ] Got command RPT from MCS: ref #841791
2018-12-15 04:40:11 [DEBUG   ] summary = ERROR
2018-12-15 04:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841791  13 58467 16811965 A  ERRORERROR'
2018-12-15 04:40:12 [DEBUG   ] Got command RPT from MCS: ref #841793
2018-12-15 04:40:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841793  77 58467 16812161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:40:12 [DEBUG   ] Got command RPT from MCS: ref #841794
2018-12-15 04:40:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841794  12 58467 16812365 A  ERRORB˜™š'
2018-12-15 04:40:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 04:40:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:40:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:40:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:40:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:40:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:40:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:40:31 [DEBUG   ] Finished updating board flags in 1.720 seconds
2018-12-15 04:40:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:40:54 [DEBUG   ] Got command RPT from MCS: ref #841799
2018-12-15 04:40:54 [DEBUG   ] summary = ERROR
2018-12-15 04:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841799  13 58467 16854793 A  ERRORERROR'
2018-12-15 04:40:54 [DEBUG   ] Got command RPT from MCS: ref #841800
2018-12-15 04:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841800  77 58467 16854794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:41:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 04:41:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 04:41:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:41:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:41:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:41:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:41:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:41:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:41:31 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-15 04:41:44 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 04:42:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 04:42:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:42:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:42:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:42:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:42:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:42:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:42:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:42:31 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-12-15 04:42:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:43:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:43:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 04:43:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:43:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:43:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:43:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:43:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:43:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:43:31 [DEBUG   ] Finished updating board flags in 1.483 seconds
2018-12-15 04:43:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:44:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 04:44:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:44:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 04:44:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:44:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:44:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:44:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:44:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:44:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:44:31 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-12-15 04:44:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:45:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:45:11 [DEBUG   ] Got command RPT from MCS: ref #841824
2018-12-15 04:45:11 [DEBUG   ] summary = ERROR
2018-12-15 04:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841824  13 58467 17111649 A  ERRORERROR'
2018-12-15 04:45:11 [DEBUG   ] Got command RPT from MCS: ref #841825
2018-12-15 04:45:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:45:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841825  77 58467 17111841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:45:12 [DEBUG   ] Got command RPT from MCS: ref #841826
2018-12-15 04:45:12 [DEBUG   ] summary = ERROR
2018-12-15 04:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841826  13 58467 17112045 A  ERRORERROR'
2018-12-15 04:45:12 [DEBUG   ] Got command RPT from MCS: ref #841827
2018-12-15 04:45:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841827  77 58467 17112249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:45:12 [DEBUG   ] Got command RPT from MCS: ref #841828
2018-12-15 04:45:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841828  12 58467 17112453 A  ERRORB˜™š'
2018-12-15 04:45:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 04:45:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:45:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 04:45:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:45:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:45:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:45:31 [WARNING ] (13, 1, 'bot')
2018-12-15 04:45:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:45:31 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-12-15 04:45:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:45:54 [DEBUG   ] Got command RPT from MCS: ref #841829
2018-12-15 04:45:54 [DEBUG   ] summary = ERROR
2018-12-15 04:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841829  13 58467 17154793 A  ERRORERROR'
2018-12-15 04:45:54 [DEBUG   ] Got command RPT from MCS: ref #841830
2018-12-15 04:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841830  77 58467 17154794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:46:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 04:46:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 04:46:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:46:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 04:46:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:46:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:46:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:46:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:46:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:46:32 [DEBUG   ] Finished updating board flags in 2.190 seconds
2018-12-15 04:46:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 04:47:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 04:47:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 04:47:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:47:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:47:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:47:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:47:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:47:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:47:32 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-12-15 04:47:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:48:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:48:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 04:48:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:48:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:48:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:48:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:48:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:48:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:48:32 [DEBUG   ] Finished updating board flags in 1.899 seconds
2018-12-15 04:48:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 04:49:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:49:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:49:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:49:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:49:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:49:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:49:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:49:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:49:32 [DEBUG   ] Finished updating board flags in 1.831 seconds
2018-12-15 04:49:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 04:50:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 04:50:11 [DEBUG   ] Got command RPT from MCS: ref #841852
2018-12-15 04:50:11 [DEBUG   ] summary = ERROR
2018-12-15 04:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841852  13 58467 17411721 A  ERRORERROR'
2018-12-15 04:50:11 [DEBUG   ] Got command RPT from MCS: ref #841853
2018-12-15 04:50:11 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:50:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841853  77 58467 17411925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:50:12 [DEBUG   ] Got command RPT from MCS: ref #841854
2018-12-15 04:50:12 [DEBUG   ] summary = ERROR
2018-12-15 04:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841854  13 58467 17412129 A  ERRORERROR'
2018-12-15 04:50:12 [DEBUG   ] Got command RPT from MCS: ref #841856
2018-12-15 04:50:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841856  77 58467 17412321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:50:12 [DEBUG   ] Got command RPT from MCS: ref #841858
2018-12-15 04:50:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841858  12 58467 17412525 A  ERRORB—™š'
2018-12-15 04:50:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 04:50:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:50:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:50:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:50:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:50:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:50:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:50:32 [DEBUG   ] Finished updating board flags in 1.776 seconds
2018-12-15 04:50:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 04:50:54 [DEBUG   ] Got command RPT from MCS: ref #841866
2018-12-15 04:50:54 [DEBUG   ] summary = ERROR
2018-12-15 04:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841866  13 58467 17454793 A  ERRORERROR'
2018-12-15 04:50:54 [DEBUG   ] Got command RPT from MCS: ref #841867
2018-12-15 04:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841867  77 58467 17454794 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:51:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 04:51:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 04:51:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:51:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 04:51:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:51:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:51:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:51:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:51:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:51:32 [DEBUG   ] Finished updating board flags in 1.637 seconds
2018-12-15 04:51:44 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 04:52:04 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-15 04:52:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 04:52:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:52:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:52:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:52:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:52:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:52:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:52:32 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-15 04:52:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 04:53:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 04:53:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 04:53:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:53:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:53:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:53:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:53:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:53:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:53:32 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-12-15 04:53:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 04:54:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:54:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 04:54:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:54:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 04:54:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:54:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:54:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:54:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:54:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:54:32 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-12-15 04:54:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 04:55:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 04:55:11 [DEBUG   ] Got command RPT from MCS: ref #841887
2018-12-15 04:55:11 [DEBUG   ] summary = ERROR
2018-12-15 04:55:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841887  13 58467 17711801 A  ERRORERROR'
2018-12-15 04:55:12 [DEBUG   ] Got command RPT from MCS: ref #841888
2018-12-15 04:55:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841888  77 58467 17712005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:55:12 [DEBUG   ] Got command RPT from MCS: ref #841889
2018-12-15 04:55:12 [DEBUG   ] summary = ERROR
2018-12-15 04:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841889  13 58467 17712209 A  ERRORERROR'
2018-12-15 04:55:12 [DEBUG   ] Got command RPT from MCS: ref #841890
2018-12-15 04:55:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841890  77 58467 17712413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:55:12 [DEBUG   ] Got command RPT from MCS: ref #841891
2018-12-15 04:55:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 04:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841891  12 58467 17712605 A  ERRORB˜™š'
2018-12-15 04:55:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 04:55:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:55:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:55:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:55:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:55:32 [WARNING ] (13, 1, 'bot')
2018-12-15 04:55:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:55:32 [DEBUG   ] Finished updating board flags in 1.542 seconds
2018-12-15 04:55:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 04:55:54 [DEBUG   ] Got command RPT from MCS: ref #841892
2018-12-15 04:55:54 [DEBUG   ] summary = ERROR
2018-12-15 04:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841892  13 58467 17754801 A  ERRORERROR'
2018-12-15 04:55:54 [DEBUG   ] Got command RPT from MCS: ref #841893
2018-12-15 04:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 04:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841893  77 58467 17754802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 04:56:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:56:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 04:56:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 04:56:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:56:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-15 04:56:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:56:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:56:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:56:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:56:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:56:33 [DEBUG   ] Finished updating board flags in 2.215 seconds
2018-12-15 04:56:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 04:57:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 04:57:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 04:57:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 04:57:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:57:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:57:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:57:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:57:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:57:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:57:33 [DEBUG   ] Finished updating board flags in 2.094 seconds
2018-12-15 04:57:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 04:58:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:58:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 04:58:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:58:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:58:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:58:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:58:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:58:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:58:33 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-12-15 04:58:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:59:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 04:59:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 04:59:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 04:59:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:59:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:59:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:59:33 [WARNING ] (13, 1, 'bot')
2018-12-15 04:59:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 04:59:33 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-12-15 04:59:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:00:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:00:11 [DEBUG   ] Got command RPT from MCS: ref #841919
2018-12-15 05:00:11 [DEBUG   ] summary = ERROR
2018-12-15 05:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841919  13 58467 18011885 A  ERRORERROR'
2018-12-15 05:00:12 [DEBUG   ] Got command RPT from MCS: ref #841920
2018-12-15 05:00:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841920  77 58467 18012090 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:00:12 [DEBUG   ] Got command RPT from MCS: ref #841921
2018-12-15 05:00:12 [DEBUG   ] summary = ERROR
2018-12-15 05:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841921  13 58467 18012293 A  ERRORERROR'
2018-12-15 05:00:12 [DEBUG   ] Got command RPT from MCS: ref #841923
2018-12-15 05:00:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841923  77 58467 18012485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:00:12 [DEBUG   ] Got command RPT from MCS: ref #841924
2018-12-15 05:00:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841924  12 58467 18012689 A  ERRORB˜™š'
2018-12-15 05:00:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:00:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:00:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:00:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:00:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:00:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:00:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:00:33 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-15 05:00:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:00:54 [DEBUG   ] Got command RPT from MCS: ref #841929
2018-12-15 05:00:54 [DEBUG   ] summary = ERROR
2018-12-15 05:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841929  13 58467 18054797 A  ERRORERROR'
2018-12-15 05:00:54 [DEBUG   ] Got command RPT from MCS: ref #841930
2018-12-15 05:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841930  77 58467 18054798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:01:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:01:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:01:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:01:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:01:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:01:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:01:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:01:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:01:33 [DEBUG   ] Finished updating board flags in 1.896 seconds
2018-12-15 05:01:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 05:02:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 05:02:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 05:02:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:02:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:02:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:02:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:02:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:02:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:02:33 [DEBUG   ] Finished updating board flags in 1.641 seconds
2018-12-15 05:02:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:03:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:03:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:03:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:03:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:03:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:03:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:03:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:03:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:03:33 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-12-15 05:03:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 05:04:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 05:04:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:04:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:04:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 05:04:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:04:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:04:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:04:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:04:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:04:33 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-15 05:04:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:05:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 05:05:11 [DEBUG   ] Got command RPT from MCS: ref #841950
2018-12-15 05:05:11 [DEBUG   ] summary = ERROR
2018-12-15 05:05:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841950  13 58467 18311969 A  ERRORERROR'
2018-12-15 05:05:12 [DEBUG   ] Got command RPT from MCS: ref #841951
2018-12-15 05:05:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841951  77 58467 18312173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:05:12 [DEBUG   ] Got command RPT from MCS: ref #841952
2018-12-15 05:05:12 [DEBUG   ] summary = ERROR
2018-12-15 05:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841952  13 58467 18312365 A  ERRORERROR'
2018-12-15 05:05:12 [DEBUG   ] Got command RPT from MCS: ref #841953
2018-12-15 05:05:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841953  77 58467 18312569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:05:12 [DEBUG   ] Got command RPT from MCS: ref #841954
2018-12-15 05:05:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841954  12 58467 18312773 A  ERRORB˜™š'
2018-12-15 05:05:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 05:05:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:05:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:05:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:05:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:05:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:05:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:05:33 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-15 05:05:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:05:54 [DEBUG   ] Got command RPT from MCS: ref #841959
2018-12-15 05:05:54 [DEBUG   ] summary = ERROR
2018-12-15 05:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841959  13 58467 18354801 A  ERRORERROR'
2018-12-15 05:05:54 [DEBUG   ] Got command RPT from MCS: ref #841960
2018-12-15 05:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841960  77 58467 18354802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:06:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:06:25 [DEBUG   ] Finished updating ant stats in 0.677 seconds
2018-12-15 05:06:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:06:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 05:06:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:06:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:06:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:06:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:06:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:06:33 [DEBUG   ] Finished updating board flags in 1.560 seconds
2018-12-15 05:06:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 05:07:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 05:07:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 05:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:07:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:07:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:07:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:07:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:07:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:07:33 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-15 05:07:45 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-15 05:08:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 05:08:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 05:08:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:08:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:08:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:08:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:08:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:08:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:08:33 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-12-15 05:08:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 05:09:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:09:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:09:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:09:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:09:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:09:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:09:33 [WARNING ] (13, 1, 'bot')
2018-12-15 05:09:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:09:33 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-12-15 05:09:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 05:10:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:10:12 [DEBUG   ] Got command RPT from MCS: ref #841982
2018-12-15 05:10:12 [DEBUG   ] summary = ERROR
2018-12-15 05:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841982  13 58467 18612041 A  ERRORERROR'
2018-12-15 05:10:12 [DEBUG   ] Got command RPT from MCS: ref #841983
2018-12-15 05:10:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841983  77 58467 18612245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:10:12 [DEBUG   ] Got command RPT from MCS: ref #841984
2018-12-15 05:10:12 [DEBUG   ] summary = ERROR
2018-12-15 05:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841984  13 58467 18612449 A  ERRORERROR'
2018-12-15 05:10:12 [DEBUG   ] Got command RPT from MCS: ref #841986
2018-12-15 05:10:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841986  77 58467 18612653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:10:12 [DEBUG   ] Got command RPT from MCS: ref #841987
2018-12-15 05:10:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841987  12 58467 18612845 A  ERRORB˜™š'
2018-12-15 05:10:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 05:10:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:10:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:10:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:10:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:10:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:10:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:10:34 [DEBUG   ] Finished updating board flags in 2.067 seconds
2018-12-15 05:10:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:10:54 [DEBUG   ] Got command RPT from MCS: ref #841992
2018-12-15 05:10:54 [DEBUG   ] summary = ERROR
2018-12-15 05:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841992  13 58467 18654801 A  ERRORERROR'
2018-12-15 05:10:54 [DEBUG   ] Got command RPT from MCS: ref #841993
2018-12-15 05:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   841993  77 58467 18654802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:11:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 05:11:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 05:11:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:11:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:11:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:11:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:11:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:11:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:11:34 [DEBUG   ] Finished updating board flags in 1.969 seconds
2018-12-15 05:11:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 05:12:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 05:12:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 05:12:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:12:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:12:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:12:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:12:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:12:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:12:34 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-15 05:12:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 05:13:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 05:13:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 05:13:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:13:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:13:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:13:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:13:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:13:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:13:34 [DEBUG   ] Finished updating board flags in 1.885 seconds
2018-12-15 05:13:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 05:14:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 05:14:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 05:14:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:14:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:14:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:14:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:14:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:14:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:14:34 [DEBUG   ] Finished updating board flags in 1.724 seconds
2018-12-15 05:14:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 05:15:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 05:15:12 [DEBUG   ] Got command RPT from MCS: ref #842017
2018-12-15 05:15:12 [DEBUG   ] summary = ERROR
2018-12-15 05:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842017  13 58467 18912125 A  ERRORERROR'
2018-12-15 05:15:12 [DEBUG   ] Got command RPT from MCS: ref #842018
2018-12-15 05:15:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842018  77 58467 18912329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:15:12 [DEBUG   ] Got command RPT from MCS: ref #842019
2018-12-15 05:15:12 [DEBUG   ] summary = ERROR
2018-12-15 05:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842019  13 58467 18912521 A  ERRORERROR'
2018-12-15 05:15:12 [DEBUG   ] Got command RPT from MCS: ref #842020
2018-12-15 05:15:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842020  77 58467 18912725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:15:12 [DEBUG   ] Got command RPT from MCS: ref #842021
2018-12-15 05:15:12 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:15:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842021  12 58467 18912929 A  ERRORB˜™š'
2018-12-15 05:15:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 05:15:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:15:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:15:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:15:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:15:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:15:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:15:34 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-15 05:15:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 05:15:54 [DEBUG   ] Got command RPT from MCS: ref #842022
2018-12-15 05:15:54 [DEBUG   ] summary = ERROR
2018-12-15 05:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842022  13 58467 18954801 A  ERRORERROR'
2018-12-15 05:15:54 [DEBUG   ] Got command RPT from MCS: ref #842023
2018-12-15 05:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842023  77 58467 18954802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:16:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 05:16:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 05:16:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 05:16:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:16:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:16:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:16:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:16:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:16:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:16:34 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-12-15 05:16:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 05:17:07 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 05:17:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 05:17:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:17:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:17:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:17:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:17:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:17:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:17:34 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-12-15 05:17:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 05:18:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 05:18:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:18:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:18:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 05:18:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:18:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:18:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:18:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:18:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:18:34 [DEBUG   ] Finished updating board flags in 1.479 seconds
2018-12-15 05:18:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:19:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:19:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 05:19:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:19:34 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 05:19:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:19:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:19:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:19:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:19:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:19:34 [DEBUG   ] Finished updating board flags in 1.483 seconds
2018-12-15 05:19:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:20:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 05:20:12 [DEBUG   ] Got command RPT from MCS: ref #842045
2018-12-15 05:20:12 [DEBUG   ] summary = ERROR
2018-12-15 05:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842045  13 58467 19212201 A  ERRORERROR'
2018-12-15 05:20:12 [DEBUG   ] Got command RPT from MCS: ref #842046
2018-12-15 05:20:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842046  77 58467 19212405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:20:12 [DEBUG   ] Got command RPT from MCS: ref #842047
2018-12-15 05:20:12 [DEBUG   ] summary = ERROR
2018-12-15 05:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842047  13 58467 19212609 A  ERRORERROR'
2018-12-15 05:20:12 [DEBUG   ] Got command RPT from MCS: ref #842049
2018-12-15 05:20:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842049  77 58467 19212813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:20:13 [DEBUG   ] Got command RPT from MCS: ref #842050
2018-12-15 05:20:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842050  12 58467 19213005 A  ERRORB™™š'
2018-12-15 05:20:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:20:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 05:20:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 05:20:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:20:34 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 05:20:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:20:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:20:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:20:34 [WARNING ] (13, 1, 'bot')
2018-12-15 05:20:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:20:34 [DEBUG   ] Finished updating board flags in 1.566 seconds
2018-12-15 05:20:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 05:20:54 [DEBUG   ] Got command RPT from MCS: ref #842059
2018-12-15 05:20:54 [DEBUG   ] summary = ERROR
2018-12-15 05:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842059  13 58467 19254797 A  ERRORERROR'
2018-12-15 05:20:54 [DEBUG   ] Got command RPT from MCS: ref #842060
2018-12-15 05:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842060  77 58467 19254798 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:21:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:21:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:21:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 05:21:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:21:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:21:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:21:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:21:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:21:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:21:35 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-12-15 05:21:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:22:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:22:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:22:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:22:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:22:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:22:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:22:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:22:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:22:35 [DEBUG   ] Finished updating board flags in 1.937 seconds
2018-12-15 05:22:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:23:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:23:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 05:23:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:23:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:23:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:23:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:23:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:23:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:23:35 [DEBUG   ] Finished updating board flags in 1.842 seconds
2018-12-15 05:23:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:24:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 05:24:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:24:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:24:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:24:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:24:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:24:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:24:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:24:35 [DEBUG   ] Finished updating board flags in 1.738 seconds
2018-12-15 05:24:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:25:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:25:12 [DEBUG   ] Got command RPT from MCS: ref #842080
2018-12-15 05:25:12 [DEBUG   ] summary = ERROR
2018-12-15 05:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842080  13 58467 19512285 A  ERRORERROR'
2018-12-15 05:25:12 [DEBUG   ] Got command RPT from MCS: ref #842081
2018-12-15 05:25:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842081  77 58467 19512489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:25:12 [DEBUG   ] Got command RPT from MCS: ref #842082
2018-12-15 05:25:12 [DEBUG   ] summary = ERROR
2018-12-15 05:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842082  13 58467 19512693 A  ERRORERROR'
2018-12-15 05:25:12 [DEBUG   ] Got command RPT from MCS: ref #842083
2018-12-15 05:25:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842083  77 58467 19512885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:25:13 [DEBUG   ] Got command RPT from MCS: ref #842084
2018-12-15 05:25:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:25:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842084  12 58467 19513089 A  ERRORB˜™š'
2018-12-15 05:25:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 05:25:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 05:25:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:25:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:25:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:25:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:25:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:25:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:25:35 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-12-15 05:25:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:25:54 [DEBUG   ] Got command RPT from MCS: ref #842085
2018-12-15 05:25:54 [DEBUG   ] summary = ERROR
2018-12-15 05:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842085  13 58467 19554805 A  ERRORERROR'
2018-12-15 05:25:54 [DEBUG   ] Got command RPT from MCS: ref #842086
2018-12-15 05:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842086  77 58467 19554806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:26:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:26:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:26:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:26:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:26:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:26:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:26:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:26:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:26:35 [DEBUG   ] Finished updating board flags in 1.659 seconds
2018-12-15 05:26:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:27:07 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-15 05:27:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:27:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 05:27:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:27:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 05:27:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:27:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:27:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:27:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:27:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:27:35 [DEBUG   ] Finished updating board flags in 1.544 seconds
2018-12-15 05:27:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 05:28:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 05:28:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 05:28:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:28:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:28:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:28:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:28:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:28:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:28:35 [DEBUG   ] Finished updating board flags in 1.525 seconds
2018-12-15 05:28:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 05:29:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 05:29:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 05:29:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:29:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:29:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:29:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:29:35 [WARNING ] (13, 1, 'bot')
2018-12-15 05:29:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:29:35 [DEBUG   ] Finished updating board flags in 1.536 seconds
2018-12-15 05:29:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 05:30:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 05:30:12 [DEBUG   ] Got command RPT from MCS: ref #842112
2018-12-15 05:30:12 [DEBUG   ] summary = ERROR
2018-12-15 05:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842112  13 58467 19812361 A  ERRORERROR'
2018-12-15 05:30:12 [DEBUG   ] Got command RPT from MCS: ref #842113
2018-12-15 05:30:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842113  77 58467 19812565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:30:12 [DEBUG   ] Got command RPT from MCS: ref #842114
2018-12-15 05:30:12 [DEBUG   ] summary = ERROR
2018-12-15 05:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842114  13 58467 19812769 A  ERRORERROR'
2018-12-15 05:30:12 [DEBUG   ] Got command RPT from MCS: ref #842116
2018-12-15 05:30:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:30:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842116  77 58467 19812973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:30:13 [DEBUG   ] Got command RPT from MCS: ref #842118
2018-12-15 05:30:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842118  12 58467 19813165 A  ERRORB—™š'
2018-12-15 05:30:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 05:30:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:30:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:30:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:30:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:30:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:30:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:30:36 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-12-15 05:30:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 05:30:54 [DEBUG   ] Got command RPT from MCS: ref #842122
2018-12-15 05:30:54 [DEBUG   ] summary = ERROR
2018-12-15 05:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842122  13 58467 19854802 A  ERRORERROR'
2018-12-15 05:30:54 [DEBUG   ] Got command RPT from MCS: ref #842123
2018-12-15 05:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842123  77 58467 19854802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:31:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 05:31:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 05:31:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:31:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:31:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:31:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:31:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:31:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:31:36 [DEBUG   ] Finished updating board flags in 2.122 seconds
2018-12-15 05:31:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 05:32:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 05:32:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 05:32:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:32:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:32:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:32:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:32:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:32:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:32:36 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-12-15 05:32:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 05:33:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 05:33:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 05:33:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:33:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:33:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:33:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:33:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:33:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:33:36 [DEBUG   ] Finished updating board flags in 1.977 seconds
2018-12-15 05:33:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 05:34:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 05:34:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:34:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:34:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:34:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:34:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:34:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:34:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:34:36 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-12-15 05:34:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:35:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:35:12 [DEBUG   ] Got command RPT from MCS: ref #842143
2018-12-15 05:35:12 [DEBUG   ] summary = ERROR
2018-12-15 05:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842143  13 58467 20112449 A  ERRORERROR'
2018-12-15 05:35:12 [DEBUG   ] Got command RPT from MCS: ref #842144
2018-12-15 05:35:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842144  77 58467 20112653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:35:12 [DEBUG   ] Got command RPT from MCS: ref #842145
2018-12-15 05:35:12 [DEBUG   ] summary = ERROR
2018-12-15 05:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842145  13 58467 20112845 A  ERRORERROR'
2018-12-15 05:35:13 [DEBUG   ] Got command RPT from MCS: ref #842146
2018-12-15 05:35:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842146  77 58467 20113049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:35:13 [DEBUG   ] Got command RPT from MCS: ref #842147
2018-12-15 05:35:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842147  12 58467 20113253 A  ERRORB˜™š'
2018-12-15 05:35:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:35:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 05:35:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:35:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:35:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:35:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:35:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:35:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:35:36 [DEBUG   ] Finished updating board flags in 1.755 seconds
2018-12-15 05:35:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:35:54 [DEBUG   ] Got command RPT from MCS: ref #842152
2018-12-15 05:35:54 [DEBUG   ] summary = ERROR
2018-12-15 05:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842152  13 58467 20154809 A  ERRORERROR'
2018-12-15 05:35:54 [DEBUG   ] Got command RPT from MCS: ref #842153
2018-12-15 05:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842153  77 58467 20154810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:36:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:36:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:36:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:36:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:36:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:36:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:36:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:36:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:36:36 [DEBUG   ] Finished updating board flags in 1.675 seconds
2018-12-15 05:36:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:37:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:37:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:37:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:37:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:37:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:37:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:37:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:37:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:37:36 [DEBUG   ] Finished updating board flags in 1.535 seconds
2018-12-15 05:37:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 05:38:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:38:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:38:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:38:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:38:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:38:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:38:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:38:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:38:36 [DEBUG   ] Finished updating board flags in 1.496 seconds
2018-12-15 05:38:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:39:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 05:39:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:39:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:39:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:39:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:39:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:39:36 [WARNING ] (13, 1, 'bot')
2018-12-15 05:39:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:39:36 [DEBUG   ] Finished updating board flags in 1.537 seconds
2018-12-15 05:39:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:40:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:40:12 [DEBUG   ] Got command RPT from MCS: ref #842175
2018-12-15 05:40:12 [DEBUG   ] summary = ERROR
2018-12-15 05:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842175  13 58467 20412533 A  ERRORERROR'
2018-12-15 05:40:12 [DEBUG   ] Got command RPT from MCS: ref #842176
2018-12-15 05:40:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842176  77 58467 20412725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:40:12 [DEBUG   ] Got command RPT from MCS: ref #842177
2018-12-15 05:40:12 [DEBUG   ] summary = ERROR
2018-12-15 05:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842177  13 58467 20412929 A  ERRORERROR'
2018-12-15 05:40:13 [DEBUG   ] Got command RPT from MCS: ref #842179
2018-12-15 05:40:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842179  77 58467 20413133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:40:13 [DEBUG   ] Got command RPT from MCS: ref #842180
2018-12-15 05:40:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842180  12 58467 20413337 A  ERRORB—™š'
2018-12-15 05:40:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:40:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:40:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:40:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:40:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:40:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:40:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:40:37 [DEBUG   ] Finished updating board flags in 2.253 seconds
2018-12-15 05:40:48 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 05:40:54 [DEBUG   ] Got command RPT from MCS: ref #842185
2018-12-15 05:40:54 [DEBUG   ] summary = ERROR
2018-12-15 05:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842185  13 58467 20454801 A  ERRORERROR'
2018-12-15 05:40:54 [DEBUG   ] Got command RPT from MCS: ref #842186
2018-12-15 05:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842186  77 58467 20454802 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:41:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:41:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:41:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:41:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:41:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:41:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:41:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:41:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:41:37 [DEBUG   ] Finished updating board flags in 2.123 seconds
2018-12-15 05:41:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:42:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:42:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:42:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:42:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:42:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:42:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:42:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:42:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:42:37 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-12-15 05:42:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:43:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:43:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:43:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:43:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:43:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:43:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:43:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:43:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:43:37 [DEBUG   ] Finished updating board flags in 1.944 seconds
2018-12-15 05:43:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:44:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:44:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:44:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 05:44:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:44:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-15 05:44:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:44:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:44:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:44:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:44:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:44:37 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-15 05:44:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 05:45:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:45:12 [DEBUG   ] Got command RPT from MCS: ref #842210
2018-12-15 05:45:12 [DEBUG   ] summary = ERROR
2018-12-15 05:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842210  13 58467 20712609 A  ERRORERROR'
2018-12-15 05:45:12 [DEBUG   ] Got command RPT from MCS: ref #842211
2018-12-15 05:45:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842211  77 58467 20712813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:45:13 [DEBUG   ] Got command RPT from MCS: ref #842212
2018-12-15 05:45:13 [DEBUG   ] summary = ERROR
2018-12-15 05:45:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842212  13 58467 20713017 A  ERRORERROR'
2018-12-15 05:45:13 [DEBUG   ] Got command RPT from MCS: ref #842213
2018-12-15 05:45:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:45:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842213  77 58467 20713209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:45:13 [DEBUG   ] Got command RPT from MCS: ref #842214
2018-12-15 05:45:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:45:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842214  12 58467 20713413 A  ERRORB™™š'
2018-12-15 05:45:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:45:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:45:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 05:45:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:45:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:45:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:45:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:45:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:45:37 [DEBUG   ] Finished updating board flags in 1.853 seconds
2018-12-15 05:45:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:45:54 [DEBUG   ] Got command RPT from MCS: ref #842215
2018-12-15 05:45:54 [DEBUG   ] summary = ERROR
2018-12-15 05:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842215  13 58467 20754813 A  ERRORERROR'
2018-12-15 05:45:54 [DEBUG   ] Got command RPT from MCS: ref #842216
2018-12-15 05:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842216  77 58467 20754814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:46:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:46:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:46:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:46:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:46:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:46:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:46:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:46:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:46:37 [DEBUG   ] Finished updating board flags in 1.725 seconds
2018-12-15 05:46:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:47:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:47:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:47:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:47:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:47:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:47:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:47:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:47:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:47:37 [DEBUG   ] Finished updating board flags in 1.664 seconds
2018-12-15 05:47:48 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-15 05:48:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 05:48:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:48:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:48:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:48:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:48:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:48:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:48:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:48:37 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-15 05:48:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 05:49:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 05:49:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:49:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 05:49:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:49:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:49:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:49:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:49:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:49:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:49:37 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-12-15 05:49:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 05:50:08 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 05:50:12 [DEBUG   ] Got command RPT from MCS: ref #842238
2018-12-15 05:50:12 [DEBUG   ] summary = ERROR
2018-12-15 05:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842238  13 58467 21012693 A  ERRORERROR'
2018-12-15 05:50:12 [DEBUG   ] Got command RPT from MCS: ref #842239
2018-12-15 05:50:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842239  77 58467 21012897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:50:13 [DEBUG   ] Got command RPT from MCS: ref #842240
2018-12-15 05:50:13 [DEBUG   ] summary = ERROR
2018-12-15 05:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842240  13 58467 21013089 A  ERRORERROR'
2018-12-15 05:50:13 [DEBUG   ] Got command RPT from MCS: ref #842242
2018-12-15 05:50:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842242  77 58467 21013293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:50:13 [DEBUG   ] Got command RPT from MCS: ref #842243
2018-12-15 05:50:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842243  12 58467 21013497 A  ERRORB˜™š'
2018-12-15 05:50:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 05:50:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:50:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:50:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:50:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:50:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:50:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:50:37 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-12-15 05:50:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 05:50:54 [DEBUG   ] Got command RPT from MCS: ref #842252
2018-12-15 05:50:54 [DEBUG   ] summary = ERROR
2018-12-15 05:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842252  13 58467 21054805 A  ERRORERROR'
2018-12-15 05:50:54 [DEBUG   ] Got command RPT from MCS: ref #842253
2018-12-15 05:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842253  77 58467 21054806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:51:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 05:51:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 05:51:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:51:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 05:51:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:51:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:51:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:51:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:51:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:51:37 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-12-15 05:51:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 05:52:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 05:52:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 05:52:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:52:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 05:52:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:52:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:52:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:52:37 [WARNING ] (13, 1, 'bot')
2018-12-15 05:52:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:52:37 [DEBUG   ] Finished updating board flags in 1.511 seconds
2018-12-15 05:52:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 05:53:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 05:53:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 05:53:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 05:53:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 05:53:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:53:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 05:53:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:53:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:53:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:53:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:53:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:53:38 [DEBUG   ] Finished updating board flags in 2.178 seconds
2018-12-15 05:53:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 05:54:09 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2018-12-15 05:54:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 05:54:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 05:54:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:54:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:54:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:54:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:54:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:54:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:54:38 [DEBUG   ] Finished updating board flags in 1.933 seconds
2018-12-15 05:54:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 05:55:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:55:12 [DEBUG   ] Got command RPT from MCS: ref #842273
2018-12-15 05:55:12 [DEBUG   ] summary = ERROR
2018-12-15 05:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842273  13 58467 21312777 A  ERRORERROR'
2018-12-15 05:55:12 [DEBUG   ] Got command RPT from MCS: ref #842274
2018-12-15 05:55:12 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:55:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842274  77 58467 21312969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:55:13 [DEBUG   ] Got command RPT from MCS: ref #842275
2018-12-15 05:55:13 [DEBUG   ] summary = ERROR
2018-12-15 05:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842275  13 58467 21313173 A  ERRORERROR'
2018-12-15 05:55:13 [DEBUG   ] Got command RPT from MCS: ref #842276
2018-12-15 05:55:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842276  77 58467 21313377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:55:13 [DEBUG   ] Got command RPT from MCS: ref #842277
2018-12-15 05:55:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 05:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842277  12 58467 21313581 A  ERRORB˜™š'
2018-12-15 05:55:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:55:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:55:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 05:55:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:55:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:55:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:55:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:55:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:55:38 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-12-15 05:55:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:55:54 [DEBUG   ] Got command RPT from MCS: ref #842278
2018-12-15 05:55:54 [DEBUG   ] summary = ERROR
2018-12-15 05:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842278  13 58467 21354809 A  ERRORERROR'
2018-12-15 05:55:54 [DEBUG   ] Got command RPT from MCS: ref #842279
2018-12-15 05:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 05:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842279  77 58467 21354810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 05:56:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 05:56:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:56:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 05:56:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:56:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:56:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:56:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:56:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:56:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:56:38 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-12-15 05:56:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:57:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:57:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 05:57:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:57:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:57:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:57:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:57:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:57:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:57:38 [DEBUG   ] Finished updating board flags in 1.648 seconds
2018-12-15 05:57:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 05:58:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:58:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 05:58:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:58:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:58:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:58:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:58:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:58:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:58:38 [DEBUG   ] Finished updating board flags in 1.668 seconds
2018-12-15 05:58:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 05:59:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 05:59:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 05:59:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 05:59:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:59:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:59:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:59:38 [WARNING ] (13, 1, 'bot')
2018-12-15 05:59:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 05:59:38 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-12-15 05:59:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 06:00:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 06:00:12 [DEBUG   ] Got command RPT from MCS: ref #842305
2018-12-15 06:00:12 [DEBUG   ] summary = ERROR
2018-12-15 06:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842305  13 58467 21612857 A  ERRORERROR'
2018-12-15 06:00:13 [DEBUG   ] Got command RPT from MCS: ref #842306
2018-12-15 06:00:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842306  77 58467 21613050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:00:13 [DEBUG   ] Got command RPT from MCS: ref #842307
2018-12-15 06:00:13 [DEBUG   ] summary = ERROR
2018-12-15 06:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842307  13 58467 21613253 A  ERRORERROR'
2018-12-15 06:00:13 [DEBUG   ] Got command RPT from MCS: ref #842309
2018-12-15 06:00:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842309  77 58467 21613457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:00:13 [DEBUG   ] Got command RPT from MCS: ref #842310
2018-12-15 06:00:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842310  12 58467 21613661 A  ERRORB˜™š'
2018-12-15 06:00:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 06:00:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:00:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:00:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:00:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:00:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:00:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:00:38 [DEBUG   ] Finished updating board flags in 1.485 seconds
2018-12-15 06:00:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:00:54 [DEBUG   ] Got command RPT from MCS: ref #842315
2018-12-15 06:00:54 [DEBUG   ] summary = ERROR
2018-12-15 06:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842315  13 58467 21654809 A  ERRORERROR'
2018-12-15 06:00:54 [DEBUG   ] Got command RPT from MCS: ref #842316
2018-12-15 06:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842316  77 58467 21654810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:01:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:01:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 06:01:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:01:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:01:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:01:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:01:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:01:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:01:38 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-12-15 06:01:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 06:02:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:02:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:02:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:02:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:02:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:02:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:02:38 [WARNING ] (13, 1, 'bot')
2018-12-15 06:02:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:02:38 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-12-15 06:02:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 06:03:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:03:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:03:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:03:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:03:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:03:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:03:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:03:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:03:39 [DEBUG   ] Finished updating board flags in 2.228 seconds
2018-12-15 06:03:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:04:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:04:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:04:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 06:04:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:04:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:04:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:04:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:04:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:04:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:04:39 [DEBUG   ] Finished updating board flags in 2.171 seconds
2018-12-15 06:04:49 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-12-15 06:05:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 06:05:12 [DEBUG   ] Got command RPT from MCS: ref #842336
2018-12-15 06:05:12 [DEBUG   ] summary = ERROR
2018-12-15 06:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842336  13 58467 21912929 A  ERRORERROR'
2018-12-15 06:05:13 [DEBUG   ] Got command RPT from MCS: ref #842337
2018-12-15 06:05:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842337  77 58467 21913133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:05:13 [DEBUG   ] Got command RPT from MCS: ref #842338
2018-12-15 06:05:13 [DEBUG   ] summary = ERROR
2018-12-15 06:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842338  13 58467 21913337 A  ERRORERROR'
2018-12-15 06:05:13 [DEBUG   ] Got command RPT from MCS: ref #842339
2018-12-15 06:05:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842339  77 58467 21913529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:05:13 [DEBUG   ] Got command RPT from MCS: ref #842340
2018-12-15 06:05:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842340  12 58467 21913733 A  ERRORB˜™š'
2018-12-15 06:05:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 06:05:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:05:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:05:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:05:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:05:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:05:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:05:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:05:39 [DEBUG   ] Finished updating board flags in 2.034 seconds
2018-12-15 06:05:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:05:54 [DEBUG   ] Got command RPT from MCS: ref #842345
2018-12-15 06:05:54 [DEBUG   ] summary = ERROR
2018-12-15 06:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842345  13 58467 21954813 A  ERRORERROR'
2018-12-15 06:05:54 [DEBUG   ] Got command RPT from MCS: ref #842346
2018-12-15 06:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842346  77 58467 21954814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:06:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 06:06:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:06:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:06:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:06:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:06:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:06:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:06:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:06:39 [DEBUG   ] Finished updating board flags in 2.072 seconds
2018-12-15 06:06:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 06:07:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 06:07:29 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-15 06:07:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:07:39 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:07:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:07:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:07:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:07:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:07:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:07:39 [DEBUG   ] Finished updating board flags in 1.894 seconds
2018-12-15 06:07:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 06:08:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 06:08:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:08:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:08:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-15 06:08:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:08:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:08:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:08:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:08:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:08:39 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-15 06:08:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 06:09:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 06:09:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 06:09:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:09:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:09:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:09:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:09:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:09:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:09:39 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-12-15 06:09:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:10:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 06:10:13 [DEBUG   ] Got command RPT from MCS: ref #842368
2018-12-15 06:10:13 [DEBUG   ] summary = ERROR
2018-12-15 06:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842368  13 58467 22213014 A  ERRORERROR'
2018-12-15 06:10:13 [DEBUG   ] Got command RPT from MCS: ref #842369
2018-12-15 06:10:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842369  77 58467 22213217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:10:13 [DEBUG   ] Got command RPT from MCS: ref #842370
2018-12-15 06:10:13 [DEBUG   ] summary = ERROR
2018-12-15 06:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842370  13 58467 22213409 A  ERRORERROR'
2018-12-15 06:10:13 [DEBUG   ] Got command RPT from MCS: ref #842372
2018-12-15 06:10:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842372  77 58467 22213613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:10:13 [DEBUG   ] Got command RPT from MCS: ref #842374
2018-12-15 06:10:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842374  12 58467 22213817 A  ERRORB™™š'
2018-12-15 06:10:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 06:10:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:10:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:10:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:10:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:10:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:10:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:10:39 [DEBUG   ] Finished updating board flags in 1.797 seconds
2018-12-15 06:10:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:10:54 [DEBUG   ] Got command RPT from MCS: ref #842378
2018-12-15 06:10:54 [DEBUG   ] summary = ERROR
2018-12-15 06:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842378  13 58467 22254817 A  ERRORERROR'
2018-12-15 06:10:54 [DEBUG   ] Got command RPT from MCS: ref #842379
2018-12-15 06:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842379  77 58467 22254818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:11:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 06:11:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 06:11:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 06:11:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:11:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:11:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:11:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:11:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:11:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:11:39 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-12-15 06:11:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 06:12:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 06:12:30 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-12-15 06:12:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:12:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:12:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:12:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:12:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:12:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:12:39 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-15 06:12:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 06:13:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 06:13:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:13:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:13:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:13:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:13:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:13:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:13:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:13:39 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-12-15 06:13:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:14:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 06:14:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 06:14:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:14:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:14:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:14:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:14:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:14:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:14:39 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-12-15 06:14:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 06:15:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:15:13 [DEBUG   ] Got command RPT from MCS: ref #842403
2018-12-15 06:15:13 [DEBUG   ] summary = ERROR
2018-12-15 06:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842403  13 58467 22513093 A  ERRORERROR'
2018-12-15 06:15:13 [DEBUG   ] Got command RPT from MCS: ref #842404
2018-12-15 06:15:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842404  77 58467 22513297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:15:13 [DEBUG   ] Got command RPT from MCS: ref #842405
2018-12-15 06:15:13 [DEBUG   ] summary = ERROR
2018-12-15 06:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842405  13 58467 22513501 A  ERRORERROR'
2018-12-15 06:15:13 [DEBUG   ] Got command RPT from MCS: ref #842406
2018-12-15 06:15:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842406  77 58467 22513693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:15:13 [DEBUG   ] Got command RPT from MCS: ref #842407
2018-12-15 06:15:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842407  12 58467 22513897 A  ERRORB˜™š'
2018-12-15 06:15:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:15:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:15:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:15:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:15:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:15:39 [WARNING ] (13, 1, 'bot')
2018-12-15 06:15:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:15:39 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-12-15 06:15:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 06:15:54 [DEBUG   ] Got command RPT from MCS: ref #842408
2018-12-15 06:15:54 [DEBUG   ] summary = ERROR
2018-12-15 06:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842408  13 58467 22554809 A  ERRORERROR'
2018-12-15 06:15:54 [DEBUG   ] Got command RPT from MCS: ref #842409
2018-12-15 06:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842409  77 58467 22554810 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:16:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:16:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:16:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:16:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:16:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:16:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:16:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:16:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:16:40 [DEBUG   ] Finished updating board flags in 2.260 seconds
2018-12-15 06:16:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:17:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 06:17:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 06:17:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:17:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:17:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:17:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:17:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:17:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:17:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:17:40 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-12-15 06:17:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:18:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:18:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 06:18:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:18:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:18:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:18:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:18:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:18:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:18:40 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-12-15 06:18:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 06:19:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:19:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:19:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:19:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:19:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:19:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:19:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:19:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:19:40 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-12-15 06:19:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 06:20:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 06:20:13 [DEBUG   ] Got command RPT from MCS: ref #842431
2018-12-15 06:20:13 [DEBUG   ] summary = ERROR
2018-12-15 06:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842431  13 58467 22813169 A  ERRORERROR'
2018-12-15 06:20:13 [DEBUG   ] Got command RPT from MCS: ref #842432
2018-12-15 06:20:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842432  77 58467 22813373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:20:13 [DEBUG   ] Got command RPT from MCS: ref #842433
2018-12-15 06:20:13 [DEBUG   ] summary = ERROR
2018-12-15 06:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842433  13 58467 22813577 A  ERRORERROR'
2018-12-15 06:20:13 [DEBUG   ] Got command RPT from MCS: ref #842435
2018-12-15 06:20:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842435  77 58467 22813781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:20:13 [DEBUG   ] Got command RPT from MCS: ref #842437
2018-12-15 06:20:13 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:20:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842437  12 58467 22813973 A  ERRORB˜™š'
2018-12-15 06:20:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:20:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:20:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:20:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:20:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:20:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:20:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:20:40 [DEBUG   ] Finished updating board flags in 1.834 seconds
2018-12-15 06:20:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:20:54 [DEBUG   ] Got command RPT from MCS: ref #842445
2018-12-15 06:20:54 [DEBUG   ] summary = ERROR
2018-12-15 06:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842445  13 58467 22854817 A  ERRORERROR'
2018-12-15 06:20:54 [DEBUG   ] Got command RPT from MCS: ref #842446
2018-12-15 06:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842446  77 58467 22854818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:21:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 06:21:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:21:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 06:21:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:21:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:21:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:21:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:21:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:21:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:21:40 [DEBUG   ] Finished updating board flags in 1.866 seconds
2018-12-15 06:21:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:22:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 06:22:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 06:22:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:22:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:22:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:22:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:22:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:22:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:22:40 [DEBUG   ] Finished updating board flags in 1.843 seconds
2018-12-15 06:22:50 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-12-15 06:23:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:23:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:23:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:23:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:23:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:23:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:23:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:23:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:23:40 [DEBUG   ] Finished updating board flags in 1.663 seconds
2018-12-15 06:23:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:24:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 06:24:30 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-15 06:24:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:24:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:24:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:24:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:24:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:24:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:24:40 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-15 06:24:51 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 06:25:11 [DEBUG   ] Finished updating ant stats in 1.189 seconds
2018-12-15 06:25:13 [DEBUG   ] Got command RPT from MCS: ref #842466
2018-12-15 06:25:13 [DEBUG   ] summary = ERROR
2018-12-15 06:25:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842466  13 58467 23113257 A  ERRORERROR'
2018-12-15 06:25:13 [DEBUG   ] Got command RPT from MCS: ref #842467
2018-12-15 06:25:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:25:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842467  77 58467 23113449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:25:13 [DEBUG   ] Got command RPT from MCS: ref #842468
2018-12-15 06:25:13 [DEBUG   ] summary = ERROR
2018-12-15 06:25:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842468  13 58467 23113653 A  ERRORERROR'
2018-12-15 06:25:13 [DEBUG   ] Got command RPT from MCS: ref #842469
2018-12-15 06:25:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:25:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842469  77 58467 23113857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:25:14 [DEBUG   ] Got command RPT from MCS: ref #842470
2018-12-15 06:25:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842470  12 58467 23114061 A  ERRORB˜™š'
2018-12-15 06:25:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:25:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:25:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:25:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:25:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:25:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:25:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:25:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:25:40 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-12-15 06:25:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 06:25:54 [DEBUG   ] Got command RPT from MCS: ref #842471
2018-12-15 06:25:54 [DEBUG   ] summary = ERROR
2018-12-15 06:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842471  13 58467 23154817 A  ERRORERROR'
2018-12-15 06:25:54 [DEBUG   ] Got command RPT from MCS: ref #842472
2018-12-15 06:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842472  77 58467 23154818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:26:11 [DEBUG   ] Finished updating ant stats in 0.986 seconds
2018-12-15 06:26:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:26:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:26:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:26:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:26:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:26:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:26:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:26:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:26:40 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-12-15 06:26:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 06:27:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 06:27:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:27:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:27:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:27:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:27:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:27:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:27:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:27:40 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-12-15 06:27:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 06:28:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 06:28:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 06:28:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:28:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:28:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:28:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:28:40 [WARNING ] (13, 1, 'bot')
2018-12-15 06:28:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:28:40 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-15 06:28:51 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 06:29:12 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 06:29:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 06:29:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:29:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:29:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:29:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:29:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:29:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:29:41 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-12-15 06:29:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 06:30:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 06:30:13 [DEBUG   ] Got command RPT from MCS: ref #842498
2018-12-15 06:30:13 [DEBUG   ] summary = ERROR
2018-12-15 06:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842498  13 58467 23413329 A  ERRORERROR'
2018-12-15 06:30:13 [DEBUG   ] Got command RPT from MCS: ref #842499
2018-12-15 06:30:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842499  77 58467 23413533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:30:13 [DEBUG   ] Got command RPT from MCS: ref #842500
2018-12-15 06:30:13 [DEBUG   ] summary = ERROR
2018-12-15 06:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842500  13 58467 23413737 A  ERRORERROR'
2018-12-15 06:30:13 [DEBUG   ] Got command RPT from MCS: ref #842502
2018-12-15 06:30:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:30:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842502  77 58467 23413929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:30:14 [DEBUG   ] Got command RPT from MCS: ref #842504
2018-12-15 06:30:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842504  12 58467 23414137 A  ERRORB˜™š'
2018-12-15 06:30:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:30:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:30:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:30:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:30:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:30:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:30:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:30:41 [DEBUG   ] Finished updating board flags in 2.185 seconds
2018-12-15 06:30:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 06:30:54 [DEBUG   ] Got command RPT from MCS: ref #842508
2018-12-15 06:30:54 [DEBUG   ] summary = ERROR
2018-12-15 06:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842508  13 58467 23454817 A  ERRORERROR'
2018-12-15 06:30:54 [DEBUG   ] Got command RPT from MCS: ref #842509
2018-12-15 06:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842509  77 58467 23454818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:31:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:31:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:31:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:31:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:31:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:31:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:31:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:31:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:31:41 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-12-15 06:31:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:32:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 06:32:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 06:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:32:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:32:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:32:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:32:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:32:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:32:41 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-12-15 06:32:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:33:12 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-15 06:33:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 06:33:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:33:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:33:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:33:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:33:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:33:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:33:41 [DEBUG   ] Finished updating board flags in 1.960 seconds
2018-12-15 06:33:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 06:34:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:34:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:34:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:34:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:34:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:34:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:34:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:34:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:34:41 [DEBUG   ] Finished updating board flags in 1.878 seconds
2018-12-15 06:34:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 06:35:12 [DEBUG   ] Finished updating ant stats in 1.372 seconds
2018-12-15 06:35:13 [DEBUG   ] Got command RPT from MCS: ref #842529
2018-12-15 06:35:13 [DEBUG   ] summary = ERROR
2018-12-15 06:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842529  13 58467 23713409 A  ERRORERROR'
2018-12-15 06:35:13 [DEBUG   ] Got command RPT from MCS: ref #842530
2018-12-15 06:35:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842530  77 58467 23713613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:35:13 [DEBUG   ] Got command RPT from MCS: ref #842531
2018-12-15 06:35:13 [DEBUG   ] summary = ERROR
2018-12-15 06:35:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842531  13 58467 23713817 A  ERRORERROR'
2018-12-15 06:35:14 [DEBUG   ] Got command RPT from MCS: ref #842532
2018-12-15 06:35:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842532  77 58467 23714021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:35:14 [DEBUG   ] Got command RPT from MCS: ref #842533
2018-12-15 06:35:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842533  12 58467 23714213 A  ERRORB˜™š'
2018-12-15 06:35:32 [DEBUG   ] Finished updating ant stats in 0.833 seconds
2018-12-15 06:35:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:35:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:35:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:35:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:35:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:35:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:35:41 [DEBUG   ] Finished updating board flags in 1.730 seconds
2018-12-15 06:35:52 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 06:35:54 [DEBUG   ] Got command RPT from MCS: ref #842538
2018-12-15 06:35:54 [DEBUG   ] summary = ERROR
2018-12-15 06:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842538  13 58467 23754825 A  ERRORERROR'
2018-12-15 06:35:54 [DEBUG   ] Got command RPT from MCS: ref #842539
2018-12-15 06:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842539  77 58467 23754826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:36:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 06:36:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 06:36:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 06:36:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:36:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:36:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:36:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:36:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:36:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:36:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:36:41 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-15 06:36:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 06:37:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:37:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:37:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:37:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:37:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:37:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:37:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:37:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:37:41 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-12-15 06:37:52 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-15 06:38:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 06:38:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 06:38:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:38:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:38:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:38:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:38:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:38:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:38:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:38:41 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-12-15 06:38:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 06:39:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:39:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:39:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:39:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:39:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:39:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:39:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:39:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:39:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:39:41 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-12-15 06:39:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 06:40:13 [DEBUG   ] Finished updating ant stats in 1.213 seconds
2018-12-15 06:40:13 [DEBUG   ] Got command RPT from MCS: ref #842561
2018-12-15 06:40:13 [DEBUG   ] summary = ERROR
2018-12-15 06:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842561  13 58467 24013497 A  ERRORERROR'
2018-12-15 06:40:13 [DEBUG   ] Got command RPT from MCS: ref #842562
2018-12-15 06:40:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842562  77 58467 24013689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:40:13 [DEBUG   ] Got command RPT from MCS: ref #842563
2018-12-15 06:40:13 [DEBUG   ] summary = ERROR
2018-12-15 06:40:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842563  13 58467 24013897 A  ERRORERROR'
2018-12-15 06:40:14 [DEBUG   ] Got command RPT from MCS: ref #842565
2018-12-15 06:40:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842565  77 58467 24014089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:40:14 [DEBUG   ] Got command RPT from MCS: ref #842567
2018-12-15 06:40:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842567  12 58467 24014293 A  ERRORB—™š'
2018-12-15 06:40:33 [DEBUG   ] Finished updating ant stats in 1.189 seconds
2018-12-15 06:40:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 06:40:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:40:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:40:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:40:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:40:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:40:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:40:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:40:41 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-15 06:40:53 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-15 06:40:54 [DEBUG   ] Got command RPT from MCS: ref #842571
2018-12-15 06:40:54 [DEBUG   ] summary = ERROR
2018-12-15 06:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842571  13 58467 24054821 A  ERRORERROR'
2018-12-15 06:40:54 [DEBUG   ] Got command RPT from MCS: ref #842572
2018-12-15 06:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842572  77 58467 24054822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:41:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:41:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:41:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:41:41 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:41:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:41:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:41:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:41:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:41:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:41:41 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-12-15 06:41:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 06:42:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:42:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 06:42:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:42:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:42:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:42:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:42:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:42:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:42:41 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-12-15 06:42:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:43:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:43:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:43:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:43:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:43:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:43:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:43:41 [WARNING ] (13, 1, 'bot')
2018-12-15 06:43:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:43:41 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-12-15 06:43:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 06:44:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:44:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:44:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:44:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-15 06:44:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:44:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:44:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:44:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:44:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:44:42 [DEBUG   ] Finished updating board flags in 2.191 seconds
2018-12-15 06:44:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:45:13 [DEBUG   ] Got command RPT from MCS: ref #842596
2018-12-15 06:45:13 [DEBUG   ] summary = ERROR
2018-12-15 06:45:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842596  13 58467 24313577 A  ERRORERROR'
2018-12-15 06:45:13 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2018-12-15 06:45:13 [DEBUG   ] Got command RPT from MCS: ref #842597
2018-12-15 06:45:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:45:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842597  77 58467 24313770 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:45:13 [DEBUG   ] Got command RPT from MCS: ref #842598
2018-12-15 06:45:13 [DEBUG   ] summary = ERROR
2018-12-15 06:45:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842598  13 58467 24313973 A  ERRORERROR'
2018-12-15 06:45:14 [DEBUG   ] Got command RPT from MCS: ref #842599
2018-12-15 06:45:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842599  77 58467 24314177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:45:14 [DEBUG   ] Got command RPT from MCS: ref #842600
2018-12-15 06:45:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842600  12 58467 24314381 A  ERRORB˜™š'
2018-12-15 06:45:33 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2018-12-15 06:45:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 06:45:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:45:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:45:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:45:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:45:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:45:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:45:42 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-12-15 06:45:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 06:45:54 [DEBUG   ] Got command RPT from MCS: ref #842601
2018-12-15 06:45:54 [DEBUG   ] summary = ERROR
2018-12-15 06:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842601  13 58467 24354817 A  ERRORERROR'
2018-12-15 06:45:54 [DEBUG   ] Got command RPT from MCS: ref #842602
2018-12-15 06:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842602  77 58467 24354818 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:46:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:46:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 06:46:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:46:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:46:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:46:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:46:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:46:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:46:42 [DEBUG   ] Finished updating board flags in 1.889 seconds
2018-12-15 06:46:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:47:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 06:47:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 06:47:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:47:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:47:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:47:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:47:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:47:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:47:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:47:42 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-15 06:47:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 06:48:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:48:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 06:48:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:48:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:48:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:48:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:48:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:48:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:48:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:48:42 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-12-15 06:48:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 06:49:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 06:49:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:49:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:49:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:49:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:49:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:49:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:49:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:49:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:49:42 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-12-15 06:49:53 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-15 06:50:13 [DEBUG   ] Got command RPT from MCS: ref #842624
2018-12-15 06:50:13 [DEBUG   ] summary = ERROR
2018-12-15 06:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842624  13 58467 24613649 A  ERRORERROR'
2018-12-15 06:50:13 [DEBUG   ] Got command RPT from MCS: ref #842625
2018-12-15 06:50:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:50:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842625  77 58467 24613853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:50:14 [DEBUG   ] Got command RPT from MCS: ref #842626
2018-12-15 06:50:14 [DEBUG   ] summary = ERROR
2018-12-15 06:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842626  13 58467 24614057 A  ERRORERROR'
2018-12-15 06:50:14 [DEBUG   ] Got command RPT from MCS: ref #842628
2018-12-15 06:50:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842628  77 58467 24614249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:50:14 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-15 06:50:14 [DEBUG   ] Got command RPT from MCS: ref #842629
2018-12-15 06:50:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842629  12 58467 24614453 A  ERRORB˜™š'
2018-12-15 06:50:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 06:50:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:50:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:50:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:50:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:50:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:50:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:50:42 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-12-15 06:50:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:50:54 [DEBUG   ] Got command RPT from MCS: ref #842638
2018-12-15 06:50:54 [DEBUG   ] summary = ERROR
2018-12-15 06:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842638  13 58467 24654825 A  ERRORERROR'
2018-12-15 06:50:54 [DEBUG   ] Got command RPT from MCS: ref #842639
2018-12-15 06:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842639  77 58467 24654826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:51:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 06:51:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 06:51:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 06:51:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:51:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:51:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:51:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:51:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:51:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:51:42 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-12-15 06:51:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 06:52:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:52:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 06:52:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 06:52:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 06:52:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:52:42 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:52:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:52:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:52:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:52:42 [WARNING ] (13, 1, 'bot')
2018-12-15 06:52:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:52:42 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-12-15 06:52:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 06:53:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:53:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 06:53:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:53:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:53:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:53:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:53:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:53:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:53:43 [DEBUG   ] Finished updating board flags in 2.182 seconds
2018-12-15 06:53:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 06:54:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 06:54:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 06:54:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:54:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:54:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:54:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:54:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:54:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:54:43 [DEBUG   ] Finished updating board flags in 1.915 seconds
2018-12-15 06:54:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 06:55:13 [DEBUG   ] Got command RPT from MCS: ref #842659
2018-12-15 06:55:13 [DEBUG   ] summary = ERROR
2018-12-15 06:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842659  13 58467 24913737 A  ERRORERROR'
2018-12-15 06:55:13 [DEBUG   ] Got command RPT from MCS: ref #842660
2018-12-15 06:55:13 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:55:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842660  77 58467 24913929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:55:14 [DEBUG   ] Got command RPT from MCS: ref #842661
2018-12-15 06:55:14 [DEBUG   ] summary = ERROR
2018-12-15 06:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842661  13 58467 24914133 A  ERRORERROR'
2018-12-15 06:55:14 [DEBUG   ] Got command RPT from MCS: ref #842662
2018-12-15 06:55:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842662  77 58467 24914337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:55:14 [DEBUG   ] Got command RPT from MCS: ref #842663
2018-12-15 06:55:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 06:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842663  12 58467 24914529 A  ERRORB™™š'
2018-12-15 06:55:14 [DEBUG   ] Finished updating ant stats in 1.556 seconds
2018-12-15 06:55:34 [DEBUG   ] Finished updating ant stats in 1.052 seconds
2018-12-15 06:55:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 06:55:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:55:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:55:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:55:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:55:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:55:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:55:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:55:43 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-12-15 06:55:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:55:54 [DEBUG   ] Got command RPT from MCS: ref #842664
2018-12-15 06:55:54 [DEBUG   ] summary = ERROR
2018-12-15 06:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842664  13 58467 24954825 A  ERRORERROR'
2018-12-15 06:55:54 [DEBUG   ] Got command RPT from MCS: ref #842665
2018-12-15 06:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 06:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842665  77 58467 24954826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 06:56:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 06:56:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 06:56:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:56:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:56:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:56:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:56:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:56:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:56:43 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-12-15 06:56:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 06:57:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 06:57:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:57:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:57:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:57:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:57:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:57:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:57:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:57:43 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-12-15 06:57:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 06:58:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 06:58:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 06:58:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:58:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:58:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:58:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:58:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:58:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:58:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:58:43 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-12-15 06:58:54 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-15 06:59:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 06:59:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 06:59:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 06:59:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 06:59:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:59:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:59:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:59:43 [WARNING ] (13, 1, 'bot')
2018-12-15 06:59:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 06:59:43 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-12-15 06:59:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 07:00:13 [DEBUG   ] Got command RPT from MCS: ref #842691
2018-12-15 07:00:13 [DEBUG   ] summary = ERROR
2018-12-15 07:00:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842691  13 58467 25213814 A  ERRORERROR'
2018-12-15 07:00:14 [DEBUG   ] Got command RPT from MCS: ref #842692
2018-12-15 07:00:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842692  77 58467 25214027 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:00:14 [DEBUG   ] Got command RPT from MCS: ref #842693
2018-12-15 07:00:14 [DEBUG   ] summary = ERROR
2018-12-15 07:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842693  13 58467 25214217 A  ERRORERROR'
2018-12-15 07:00:14 [DEBUG   ] Got command RPT from MCS: ref #842695
2018-12-15 07:00:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842695  77 58467 25214409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:00:14 [DEBUG   ] Got command RPT from MCS: ref #842696
2018-12-15 07:00:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842696  12 58467 25214613 A  ERRORB˜™š'
2018-12-15 07:00:14 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2018-12-15 07:00:34 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2018-12-15 07:00:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:00:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:00:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:00:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:00:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:00:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:00:44 [DEBUG   ] Finished updating board flags in 2.046 seconds
2018-12-15 07:00:54 [DEBUG   ] Got command RPT from MCS: ref #842701
2018-12-15 07:00:54 [DEBUG   ] summary = ERROR
2018-12-15 07:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842701  13 58467 25254821 A  ERRORERROR'
2018-12-15 07:00:54 [DEBUG   ] Got command RPT from MCS: ref #842702
2018-12-15 07:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842702  77 58467 25254822 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:00:55 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 07:01:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 07:01:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:01:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:01:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:01:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:01:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:01:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:01:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:01:44 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-12-15 07:01:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:02:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:02:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:02:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:02:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:02:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:02:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:02:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:02:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:02:44 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-12-15 07:02:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:03:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:03:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:03:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:03:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 07:03:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:03:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:03:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:03:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:03:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:03:44 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-12-15 07:03:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:04:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:04:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:04:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:04:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:04:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:04:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:04:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:04:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:04:44 [DEBUG   ] Finished updating board flags in 1.957 seconds
2018-12-15 07:04:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:05:13 [DEBUG   ] Got command RPT from MCS: ref #842722
2018-12-15 07:05:13 [DEBUG   ] summary = ERROR
2018-12-15 07:05:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842722  13 58467 25513897 A  ERRORERROR'
2018-12-15 07:05:14 [DEBUG   ] Got command RPT from MCS: ref #842723
2018-12-15 07:05:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842723  77 58467 25514089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:05:14 [DEBUG   ] Got command RPT from MCS: ref #842724
2018-12-15 07:05:14 [DEBUG   ] summary = ERROR
2018-12-15 07:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842724  13 58467 25514293 A  ERRORERROR'
2018-12-15 07:05:14 [DEBUG   ] Got command RPT from MCS: ref #842725
2018-12-15 07:05:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842725  77 58467 25514489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:05:14 [DEBUG   ] Got command RPT from MCS: ref #842726
2018-12-15 07:05:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842726  12 58467 25514693 A  ERRORB˜™š'
2018-12-15 07:05:15 [DEBUG   ] Finished updating ant stats in 1.277 seconds
2018-12-15 07:05:35 [DEBUG   ] Finished updating ant stats in 1.128 seconds
2018-12-15 07:05:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:05:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:05:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:05:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:05:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:05:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:05:44 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-15 07:05:54 [DEBUG   ] Got command RPT from MCS: ref #842731
2018-12-15 07:05:54 [DEBUG   ] summary = ERROR
2018-12-15 07:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842731  13 58467 25554825 A  ERRORERROR'
2018-12-15 07:05:54 [DEBUG   ] Got command RPT from MCS: ref #842732
2018-12-15 07:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842732  77 58467 25554826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:05:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 07:06:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 07:06:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 07:06:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:06:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:06:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:06:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:06:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:06:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:06:44 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-12-15 07:06:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 07:07:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 07:07:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 07:07:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:07:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:07:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:07:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:07:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:07:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:07:44 [DEBUG   ] Finished updating board flags in 1.662 seconds
2018-12-15 07:07:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 07:08:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 07:08:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 07:08:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:08:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:08:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:08:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:08:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:08:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:08:44 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-12-15 07:08:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 07:09:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 07:09:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 07:09:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:09:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:09:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:09:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:09:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:09:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:09:44 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-12-15 07:09:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 07:10:13 [DEBUG   ] Got command RPT from MCS: ref #842754
2018-12-15 07:10:13 [DEBUG   ] summary = ERROR
2018-12-15 07:10:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842754  13 58467 25813965 A  ERRORERROR'
2018-12-15 07:10:14 [DEBUG   ] Got command RPT from MCS: ref #842755
2018-12-15 07:10:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842755  77 58467 25814169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:10:14 [DEBUG   ] Got command RPT from MCS: ref #842756
2018-12-15 07:10:14 [DEBUG   ] summary = ERROR
2018-12-15 07:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842756  13 58467 25814378 A  ERRORERROR'
2018-12-15 07:10:14 [DEBUG   ] Got command RPT from MCS: ref #842758
2018-12-15 07:10:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842758  77 58467 25814569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:10:14 [DEBUG   ] Got command RPT from MCS: ref #842759
2018-12-15 07:10:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842759  12 58467 25814773 A  ERRORB˜™š'
2018-12-15 07:10:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 07:10:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 07:10:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:10:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:10:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:10:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:10:44 [WARNING ] (13, 1, 'bot')
2018-12-15 07:10:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:10:44 [DEBUG   ] Finished updating board flags in 1.530 seconds
2018-12-15 07:10:54 [DEBUG   ] Got command RPT from MCS: ref #842764
2018-12-15 07:10:54 [DEBUG   ] summary = ERROR
2018-12-15 07:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842764  13 58467 25854825 A  ERRORERROR'
2018-12-15 07:10:54 [DEBUG   ] Got command RPT from MCS: ref #842765
2018-12-15 07:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842765  77 58467 25854826 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:10:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 07:11:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 07:11:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 07:11:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:11:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 07:11:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:11:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:11:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:11:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:11:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:11:45 [DEBUG   ] Finished updating board flags in 2.243 seconds
2018-12-15 07:11:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 07:12:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 07:12:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 07:12:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:12:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:12:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:12:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:12:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:12:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:12:45 [DEBUG   ] Finished updating board flags in 2.142 seconds
2018-12-15 07:12:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 07:13:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 07:13:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 07:13:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:13:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:13:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:13:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:13:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:13:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:13:45 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-12-15 07:13:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 07:14:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 07:14:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 07:14:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 07:14:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:14:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 07:14:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:14:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:14:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:14:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:14:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:14:45 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-12-15 07:14:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 07:15:14 [DEBUG   ] Got command RPT from MCS: ref #842789
2018-12-15 07:15:14 [DEBUG   ] summary = ERROR
2018-12-15 07:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842789  13 58467 26114053 A  ERRORERROR'
2018-12-15 07:15:14 [DEBUG   ] Got command RPT from MCS: ref #842790
2018-12-15 07:15:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842790  77 58467 26114249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:15:14 [DEBUG   ] Got command RPT from MCS: ref #842791
2018-12-15 07:15:14 [DEBUG   ] summary = ERROR
2018-12-15 07:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842791  13 58467 26114453 A  ERRORERROR'
2018-12-15 07:15:14 [DEBUG   ] Got command RPT from MCS: ref #842792
2018-12-15 07:15:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842792  77 58467 26114649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:15:14 [DEBUG   ] Got command RPT from MCS: ref #842793
2018-12-15 07:15:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:15:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842793  12 58467 26114854 A  ERRORB—™š'
2018-12-15 07:15:15 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-12-15 07:15:35 [DEBUG   ] Finished updating ant stats in 0.449 seconds
2018-12-15 07:15:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:15:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:15:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:15:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:15:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:15:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:15:45 [DEBUG   ] Finished updating board flags in 1.953 seconds
2018-12-15 07:15:54 [DEBUG   ] Got command RPT from MCS: ref #842794
2018-12-15 07:15:54 [DEBUG   ] summary = ERROR
2018-12-15 07:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842794  13 58467 26154829 A  ERRORERROR'
2018-12-15 07:15:54 [DEBUG   ] Got command RPT from MCS: ref #842795
2018-12-15 07:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842795  77 58467 26154830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:15:56 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 07:16:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 07:16:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:16:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:16:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:16:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:16:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:16:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:16:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:16:45 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-12-15 07:16:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:17:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:17:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:17:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:17:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 07:17:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:17:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:17:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:17:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:17:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:17:45 [DEBUG   ] Finished updating board flags in 1.836 seconds
2018-12-15 07:17:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:18:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:18:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:18:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:18:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 07:18:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 07:18:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:18:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:18:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:18:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:18:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:18:45 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-12-15 07:18:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:19:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:19:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:19:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:19:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:19:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:19:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:19:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:19:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:19:45 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-12-15 07:19:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:20:14 [DEBUG   ] Got command RPT from MCS: ref #842817
2018-12-15 07:20:14 [DEBUG   ] summary = ERROR
2018-12-15 07:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842817  13 58467 26414125 A  ERRORERROR'
2018-12-15 07:20:14 [DEBUG   ] Got command RPT from MCS: ref #842818
2018-12-15 07:20:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842818  77 58467 26414329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:20:14 [DEBUG   ] Got command RPT from MCS: ref #842819
2018-12-15 07:20:14 [DEBUG   ] summary = ERROR
2018-12-15 07:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842819  13 58467 26414534 A  ERRORERROR'
2018-12-15 07:20:14 [DEBUG   ] Got command RPT from MCS: ref #842821
2018-12-15 07:20:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842821  77 58467 26414737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:20:14 [DEBUG   ] Got command RPT from MCS: ref #842822
2018-12-15 07:20:14 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:20:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842822  12 58467 26414929 A  ERRORB˜™š'
2018-12-15 07:20:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:20:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:20:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:20:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:20:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:20:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:20:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:20:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:20:45 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-12-15 07:20:54 [DEBUG   ] Got command RPT from MCS: ref #842831
2018-12-15 07:20:54 [DEBUG   ] summary = ERROR
2018-12-15 07:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842831  13 58467 26454833 A  ERRORERROR'
2018-12-15 07:20:54 [DEBUG   ] Got command RPT from MCS: ref #842832
2018-12-15 07:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842832  77 58467 26454834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:20:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:21:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 07:21:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:21:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:21:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:21:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:21:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:21:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:21:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:21:45 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-12-15 07:21:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:22:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:22:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:22:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 07:22:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:22:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:22:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:22:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:22:45 [WARNING ] (13, 1, 'bot')
2018-12-15 07:22:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:22:45 [DEBUG   ] Finished updating board flags in 1.541 seconds
2018-12-15 07:22:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:23:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:23:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:23:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:23:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 07:23:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:23:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:23:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:23:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:23:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:23:46 [DEBUG   ] Finished updating board flags in 2.253 seconds
2018-12-15 07:23:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:24:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:24:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:24:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:24:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:24:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:24:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:24:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:24:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:24:46 [DEBUG   ] Finished updating board flags in 2.133 seconds
2018-12-15 07:24:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:25:14 [DEBUG   ] Got command RPT from MCS: ref #842852
2018-12-15 07:25:14 [DEBUG   ] summary = ERROR
2018-12-15 07:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842852  13 58467 26714213 A  ERRORERROR'
2018-12-15 07:25:14 [DEBUG   ] Got command RPT from MCS: ref #842853
2018-12-15 07:25:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842853  77 58467 26714405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:25:14 [DEBUG   ] Got command RPT from MCS: ref #842854
2018-12-15 07:25:14 [DEBUG   ] summary = ERROR
2018-12-15 07:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842854  13 58467 26714609 A  ERRORERROR'
2018-12-15 07:25:14 [DEBUG   ] Got command RPT from MCS: ref #842855
2018-12-15 07:25:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842855  77 58467 26714813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:25:15 [DEBUG   ] Got command RPT from MCS: ref #842856
2018-12-15 07:25:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842856  12 58467 26715017 A  ERRORB˜™š'
2018-12-15 07:25:16 [DEBUG   ] Finished updating ant stats in 1.265 seconds
2018-12-15 07:25:36 [DEBUG   ] Finished updating ant stats in 1.138 seconds
2018-12-15 07:25:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:25:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:25:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:25:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:25:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:25:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:25:46 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-12-15 07:25:54 [DEBUG   ] Got command RPT from MCS: ref #842857
2018-12-15 07:25:54 [DEBUG   ] summary = ERROR
2018-12-15 07:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842857  13 58467 26754829 A  ERRORERROR'
2018-12-15 07:25:54 [DEBUG   ] Got command RPT from MCS: ref #842858
2018-12-15 07:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842858  77 58467 26754830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:25:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 07:26:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 07:26:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 07:26:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 07:26:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:26:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 07:26:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:26:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:26:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:26:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:26:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:26:46 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-12-15 07:26:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 07:27:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 07:27:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 07:27:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:27:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 07:27:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 07:27:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:27:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:27:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:27:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:27:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:27:46 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-12-15 07:27:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 07:28:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 07:28:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 07:28:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:28:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-15 07:28:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:28:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:28:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:28:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:28:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:28:46 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-15 07:28:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 07:29:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 07:29:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 07:29:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:29:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:29:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:29:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:29:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:29:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:29:46 [DEBUG   ] Finished updating board flags in 1.701 seconds
2018-12-15 07:29:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 07:30:14 [DEBUG   ] Got command RPT from MCS: ref #842884
2018-12-15 07:30:14 [DEBUG   ] summary = ERROR
2018-12-15 07:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842884  13 58467 27014285 A  ERRORERROR'
2018-12-15 07:30:14 [DEBUG   ] Got command RPT from MCS: ref #842885
2018-12-15 07:30:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842885  77 58467 27014489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:30:14 [DEBUG   ] Got command RPT from MCS: ref #842886
2018-12-15 07:30:14 [DEBUG   ] summary = ERROR
2018-12-15 07:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842886  13 58467 27014693 A  ERRORERROR'
2018-12-15 07:30:14 [DEBUG   ] Got command RPT from MCS: ref #842888
2018-12-15 07:30:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:30:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842888  77 58467 27014885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:30:15 [DEBUG   ] Got command RPT from MCS: ref #842889
2018-12-15 07:30:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842889  12 58467 27015089 A  ERRORB™™š'
2018-12-15 07:30:16 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2018-12-15 07:30:37 [DEBUG   ] Finished updating ant stats in 1.957 seconds
2018-12-15 07:30:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 07:30:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:30:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:30:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:30:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:30:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:30:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:30:46 [DEBUG   ] Finished updating board flags in 1.606 seconds
2018-12-15 07:30:54 [DEBUG   ] Got command RPT from MCS: ref #842894
2018-12-15 07:30:54 [DEBUG   ] summary = ERROR
2018-12-15 07:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842894  13 58467 27054829 A  ERRORERROR'
2018-12-15 07:30:54 [DEBUG   ] Got command RPT from MCS: ref #842895
2018-12-15 07:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842895  77 58467 27054830 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:30:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:31:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:31:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:31:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:31:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:31:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:31:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:31:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:31:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:31:46 [DEBUG   ] Finished updating board flags in 1.535 seconds
2018-12-15 07:31:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 07:32:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 07:32:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:32:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:32:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:32:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:32:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:32:46 [WARNING ] (13, 1, 'bot')
2018-12-15 07:32:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:32:46 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-12-15 07:32:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:33:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 07:33:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 07:33:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:33:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:33:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:33:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:33:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:33:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:33:47 [DEBUG   ] Finished updating board flags in 2.262 seconds
2018-12-15 07:33:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 07:34:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 07:34:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 07:34:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:34:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 07:34:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:34:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:34:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:34:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:34:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:34:47 [DEBUG   ] Finished updating board flags in 2.134 seconds
2018-12-15 07:34:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 07:35:14 [DEBUG   ] Got command RPT from MCS: ref #842915
2018-12-15 07:35:14 [DEBUG   ] summary = ERROR
2018-12-15 07:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842915  13 58467 27314369 A  ERRORERROR'
2018-12-15 07:35:14 [DEBUG   ] Got command RPT from MCS: ref #842916
2018-12-15 07:35:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842916  77 58467 27314573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:35:14 [DEBUG   ] Got command RPT from MCS: ref #842917
2018-12-15 07:35:14 [DEBUG   ] summary = ERROR
2018-12-15 07:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842917  13 58467 27314765 A  ERRORERROR'
2018-12-15 07:35:14 [DEBUG   ] Got command RPT from MCS: ref #842918
2018-12-15 07:35:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:35:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842918  77 58467 27314969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:35:15 [DEBUG   ] Got command RPT from MCS: ref #842919
2018-12-15 07:35:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842919  12 58467 27315173 A  ERRORB˜™š'
2018-12-15 07:35:17 [DEBUG   ] Finished updating ant stats in 1.929 seconds
2018-12-15 07:35:36 [DEBUG   ] Finished updating ant stats in 0.465 seconds
2018-12-15 07:35:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:35:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:35:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:35:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:35:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:35:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:35:47 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-12-15 07:35:54 [DEBUG   ] Got command RPT from MCS: ref #842924
2018-12-15 07:35:54 [DEBUG   ] summary = ERROR
2018-12-15 07:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842924  13 58467 27354837 A  ERRORERROR'
2018-12-15 07:35:54 [DEBUG   ] Got command RPT from MCS: ref #842925
2018-12-15 07:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842925  77 58467 27354838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:35:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 07:36:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 07:36:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:36:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:36:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:36:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:36:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:36:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:36:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:36:47 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-12-15 07:36:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 07:37:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:37:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:37:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 07:37:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:37:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:37:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:37:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:37:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:37:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:37:47 [DEBUG   ] Finished updating board flags in 2.063 seconds
2018-12-15 07:37:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:38:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:38:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:38:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:38:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:38:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:38:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:38:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:38:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:38:47 [DEBUG   ] Finished updating board flags in 1.922 seconds
2018-12-15 07:38:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:39:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:39:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:39:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 07:39:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:39:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:39:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:39:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:39:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:39:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:39:47 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-12-15 07:39:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:40:14 [DEBUG   ] Got command RPT from MCS: ref #842947
2018-12-15 07:40:14 [DEBUG   ] summary = ERROR
2018-12-15 07:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842947  13 58467 27614445 A  ERRORERROR'
2018-12-15 07:40:14 [DEBUG   ] Got command RPT from MCS: ref #842948
2018-12-15 07:40:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842948  77 58467 27614649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:40:14 [DEBUG   ] Got command RPT from MCS: ref #842949
2018-12-15 07:40:14 [DEBUG   ] summary = ERROR
2018-12-15 07:40:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842949  13 58467 27614853 A  ERRORERROR'
2018-12-15 07:40:15 [DEBUG   ] Got command RPT from MCS: ref #842951
2018-12-15 07:40:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842951  77 58467 27615045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:40:15 [DEBUG   ] Got command RPT from MCS: ref #842953
2018-12-15 07:40:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842953  12 58467 27615249 A  ERRORB˜™š'
2018-12-15 07:40:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:40:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:40:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:40:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:40:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:40:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:40:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:40:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:40:47 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-12-15 07:40:54 [DEBUG   ] Got command RPT from MCS: ref #842957
2018-12-15 07:40:54 [DEBUG   ] summary = ERROR
2018-12-15 07:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842957  13 58467 27654833 A  ERRORERROR'
2018-12-15 07:40:54 [DEBUG   ] Got command RPT from MCS: ref #842958
2018-12-15 07:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842958  77 58467 27654834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:40:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:41:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:41:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:41:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:41:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 07:41:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:41:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:41:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:41:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:41:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:41:47 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-15 07:41:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:42:17 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2018-12-15 07:42:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 07:42:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 07:42:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:42:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:42:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:42:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:42:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:42:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:42:47 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-12-15 07:42:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 07:43:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 07:43:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 07:43:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:43:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:43:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:43:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:43:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:43:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:43:47 [DEBUG   ] Finished updating board flags in 1.488 seconds
2018-12-15 07:43:57 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 07:44:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 07:44:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:44:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:44:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:44:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:44:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:44:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:44:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:44:47 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-12-15 07:44:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 07:45:14 [DEBUG   ] Got command RPT from MCS: ref #842982
2018-12-15 07:45:14 [DEBUG   ] summary = ERROR
2018-12-15 07:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842982  13 58467 27914529 A  ERRORERROR'
2018-12-15 07:45:14 [DEBUG   ] Got command RPT from MCS: ref #842983
2018-12-15 07:45:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842983  77 58467 27914733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:45:14 [DEBUG   ] Got command RPT from MCS: ref #842984
2018-12-15 07:45:14 [DEBUG   ] summary = ERROR
2018-12-15 07:45:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842984  13 58467 27914925 A  ERRORERROR'
2018-12-15 07:45:15 [DEBUG   ] Got command RPT from MCS: ref #842985
2018-12-15 07:45:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842985  77 58467 27915129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:45:15 [DEBUG   ] Got command RPT from MCS: ref #842986
2018-12-15 07:45:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842986  12 58467 27915333 A  ERRORB˜™š'
2018-12-15 07:45:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:45:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 07:45:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 07:45:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:45:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:45:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:45:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:45:47 [WARNING ] (13, 1, 'bot')
2018-12-15 07:45:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:45:47 [DEBUG   ] Finished updating board flags in 1.535 seconds
2018-12-15 07:45:54 [DEBUG   ] Got command RPT from MCS: ref #842987
2018-12-15 07:45:54 [DEBUG   ] summary = ERROR
2018-12-15 07:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842987  13 58467 27954833 A  ERRORERROR'
2018-12-15 07:45:54 [DEBUG   ] Got command RPT from MCS: ref #842988
2018-12-15 07:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   842988  77 58467 27954834 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:45:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:46:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 07:46:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:46:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 07:46:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:46:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 07:46:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:46:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:46:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:46:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:46:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:46:48 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-12-15 07:46:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 07:47:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 07:47:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 07:47:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:47:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:47:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:47:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:47:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:47:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:47:48 [DEBUG   ] Finished updating board flags in 1.922 seconds
2018-12-15 07:47:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:48:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 07:48:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:48:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:48:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:48:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:48:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:48:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:48:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:48:48 [DEBUG   ] Finished updating board flags in 1.862 seconds
2018-12-15 07:48:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 07:49:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 07:49:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 07:49:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 07:49:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:49:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:49:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:49:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:49:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:49:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:49:48 [DEBUG   ] Finished updating board flags in 1.748 seconds
2018-12-15 07:49:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 07:50:14 [DEBUG   ] Got command RPT from MCS: ref #843010
2018-12-15 07:50:14 [DEBUG   ] summary = ERROR
2018-12-15 07:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843010  13 58467 28214601 A  ERRORERROR'
2018-12-15 07:50:14 [DEBUG   ] Got command RPT from MCS: ref #843011
2018-12-15 07:50:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:50:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843011  77 58467 28214805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:50:15 [DEBUG   ] Got command RPT from MCS: ref #843012
2018-12-15 07:50:15 [DEBUG   ] summary = ERROR
2018-12-15 07:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843012  13 58467 28215009 A  ERRORERROR'
2018-12-15 07:50:15 [DEBUG   ] Got command RPT from MCS: ref #843014
2018-12-15 07:50:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843014  77 58467 28215213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:50:15 [DEBUG   ] Got command RPT from MCS: ref #843015
2018-12-15 07:50:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843015  12 58467 28215405 A  ERRORB˜™š'
2018-12-15 07:50:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 07:50:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 07:50:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:50:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:50:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:50:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:50:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:50:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:50:48 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-12-15 07:50:54 [DEBUG   ] Got command RPT from MCS: ref #843024
2018-12-15 07:50:54 [DEBUG   ] summary = ERROR
2018-12-15 07:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843024  13 58467 28254837 A  ERRORERROR'
2018-12-15 07:50:54 [DEBUG   ] Got command RPT from MCS: ref #843025
2018-12-15 07:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843025  77 58467 28254838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:50:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 07:51:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 07:51:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 07:51:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:51:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:51:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:51:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:51:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:51:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:51:48 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-12-15 07:51:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 07:52:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 07:52:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 07:52:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 07:52:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:52:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:52:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:52:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:52:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:52:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:52:48 [DEBUG   ] Finished updating board flags in 1.547 seconds
2018-12-15 07:52:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 07:53:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 07:53:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 07:53:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:53:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:53:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:53:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:53:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:53:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:53:48 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-12-15 07:53:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 07:54:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 07:54:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 07:54:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:54:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:54:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:54:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:54:48 [WARNING ] (13, 1, 'bot')
2018-12-15 07:54:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:54:48 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-12-15 07:54:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 07:55:14 [DEBUG   ] Got command RPT from MCS: ref #843045
2018-12-15 07:55:14 [DEBUG   ] summary = ERROR
2018-12-15 07:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843045  13 58467 28514685 A  ERRORERROR'
2018-12-15 07:55:14 [DEBUG   ] Got command RPT from MCS: ref #843046
2018-12-15 07:55:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:55:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843046  77 58467 28514889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:55:15 [DEBUG   ] Got command RPT from MCS: ref #843047
2018-12-15 07:55:15 [DEBUG   ] summary = ERROR
2018-12-15 07:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843047  13 58467 28515093 A  ERRORERROR'
2018-12-15 07:55:15 [DEBUG   ] Got command RPT from MCS: ref #843048
2018-12-15 07:55:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843048  77 58467 28515285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:55:15 [DEBUG   ] Got command RPT from MCS: ref #843049
2018-12-15 07:55:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 07:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843049  12 58467 28515489 A  ERRORB˜™š'
2018-12-15 07:55:17 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2018-12-15 07:55:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 07:55:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:55:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:55:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:55:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:55:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:55:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:55:49 [DEBUG   ] Finished updating board flags in 2.227 seconds
2018-12-15 07:55:54 [DEBUG   ] Got command RPT from MCS: ref #843050
2018-12-15 07:55:54 [DEBUG   ] summary = ERROR
2018-12-15 07:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843050  13 58467 28554837 A  ERRORERROR'
2018-12-15 07:55:54 [DEBUG   ] Got command RPT from MCS: ref #843051
2018-12-15 07:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 07:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843051  77 58467 28554838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 07:55:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 07:56:18 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 07:56:38 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 07:56:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:56:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:56:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:56:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:56:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:56:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:56:49 [DEBUG   ] Finished updating board flags in 2.111 seconds
2018-12-15 07:56:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 07:57:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:57:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:57:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:57:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:57:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:57:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:57:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:57:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:57:49 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-12-15 07:57:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:58:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:58:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:58:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:58:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:58:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:58:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:58:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:58:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:58:49 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-12-15 07:58:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:59:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 07:59:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 07:59:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 07:59:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-15 07:59:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:59:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:59:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:59:49 [WARNING ] (13, 1, 'bot')
2018-12-15 07:59:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 07:59:49 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-12-15 07:59:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:00:14 [DEBUG   ] Got command RPT from MCS: ref #843077
2018-12-15 08:00:14 [DEBUG   ] summary = ERROR
2018-12-15 08:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843077  13 58467 28814769 A  ERRORERROR'
2018-12-15 08:00:14 [DEBUG   ] Got command RPT from MCS: ref #843078
2018-12-15 08:00:14 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843078  77 58467 28814973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:00:15 [DEBUG   ] Got command RPT from MCS: ref #843079
2018-12-15 08:00:15 [DEBUG   ] summary = ERROR
2018-12-15 08:00:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843079  13 58467 28815165 A  ERRORERROR'
2018-12-15 08:00:15 [DEBUG   ] Got command RPT from MCS: ref #843081
2018-12-15 08:00:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:00:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843081  77 58467 28815369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:00:15 [DEBUG   ] Got command RPT from MCS: ref #843082
2018-12-15 08:00:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:00:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843082  12 58467 28815573 A  ERRORB™™š'
2018-12-15 08:00:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:00:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:00:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:00:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 08:00:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:00:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:00:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:00:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:00:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:00:49 [DEBUG   ] Finished updating board flags in 2.101 seconds
2018-12-15 08:00:54 [DEBUG   ] Got command RPT from MCS: ref #843087
2018-12-15 08:00:54 [DEBUG   ] summary = ERROR
2018-12-15 08:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843087  13 58467 28854841 A  ERRORERROR'
2018-12-15 08:00:54 [DEBUG   ] Got command RPT from MCS: ref #843088
2018-12-15 08:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843088  77 58467 28854842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:00:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:01:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:01:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:01:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 08:01:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:01:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 08:01:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:01:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:01:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:01:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:01:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:01:49 [DEBUG   ] Finished updating board flags in 1.890 seconds
2018-12-15 08:01:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:02:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 08:02:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:02:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:02:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 08:02:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:02:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:02:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:02:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:02:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:02:49 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-12-15 08:02:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:03:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:03:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 08:03:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:03:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:03:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:03:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:03:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:03:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:03:49 [DEBUG   ] Finished updating board flags in 1.680 seconds
2018-12-15 08:03:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 08:04:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 08:04:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 08:04:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:04:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 08:04:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:04:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:04:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:04:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:04:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:04:49 [DEBUG   ] Finished updating board flags in 1.560 seconds
2018-12-15 08:04:58 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-12-15 08:05:14 [DEBUG   ] Got command RPT from MCS: ref #843108
2018-12-15 08:05:14 [DEBUG   ] summary = ERROR
2018-12-15 08:05:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843108  13 58467 29114845 A  ERRORERROR'
2018-12-15 08:05:15 [DEBUG   ] Got command RPT from MCS: ref #843109
2018-12-15 08:05:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843109  77 58467 29115049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:05:15 [DEBUG   ] Got command RPT from MCS: ref #843110
2018-12-15 08:05:15 [DEBUG   ] summary = ERROR
2018-12-15 08:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843110  13 58467 29115253 A  ERRORERROR'
2018-12-15 08:05:15 [DEBUG   ] Got command RPT from MCS: ref #843111
2018-12-15 08:05:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843111  77 58467 29115445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:05:15 [DEBUG   ] Got command RPT from MCS: ref #843112
2018-12-15 08:05:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843112  12 58467 29115649 A  ERRORB™™š'
2018-12-15 08:05:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 08:05:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 08:05:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:05:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:05:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:05:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:05:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:05:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:05:49 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-12-15 08:05:54 [DEBUG   ] Got command RPT from MCS: ref #843117
2018-12-15 08:05:54 [DEBUG   ] summary = ERROR
2018-12-15 08:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843117  13 58467 29154837 A  ERRORERROR'
2018-12-15 08:05:54 [DEBUG   ] Got command RPT from MCS: ref #843118
2018-12-15 08:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843118  77 58467 29154838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:05:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 08:06:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 08:06:38 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-15 08:06:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:06:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:06:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:06:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:06:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:06:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:06:49 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-12-15 08:06:59 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-12-15 08:07:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 08:07:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:07:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:07:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:07:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:07:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:07:49 [WARNING ] (13, 1, 'bot')
2018-12-15 08:07:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:07:49 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-12-15 08:07:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:08:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:08:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 08:08:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:08:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:08:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:08:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:08:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:08:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:08:50 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-12-15 08:08:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:09:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:09:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:09:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:09:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:09:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:09:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:09:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:09:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:09:50 [DEBUG   ] Finished updating board flags in 2.107 seconds
2018-12-15 08:09:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:10:14 [DEBUG   ] Got command RPT from MCS: ref #843140
2018-12-15 08:10:14 [DEBUG   ] summary = ERROR
2018-12-15 08:10:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843140  13 58467 29414926 A  ERRORERROR'
2018-12-15 08:10:15 [DEBUG   ] Got command RPT from MCS: ref #843141
2018-12-15 08:10:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843141  77 58467 29415129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:10:15 [DEBUG   ] Got command RPT from MCS: ref #843142
2018-12-15 08:10:15 [DEBUG   ] summary = ERROR
2018-12-15 08:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843142  13 58467 29415333 A  ERRORERROR'
2018-12-15 08:10:15 [DEBUG   ] Got command RPT from MCS: ref #843144
2018-12-15 08:10:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843144  77 58467 29415537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:10:15 [DEBUG   ] Got command RPT from MCS: ref #843146
2018-12-15 08:10:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843146  12 58467 29415729 A  ERRORB˜™š'
2018-12-15 08:10:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:10:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 08:10:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:10:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:10:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:10:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:10:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:10:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:10:50 [DEBUG   ] Finished updating board flags in 1.902 seconds
2018-12-15 08:10:54 [DEBUG   ] Got command RPT from MCS: ref #843150
2018-12-15 08:10:54 [DEBUG   ] summary = ERROR
2018-12-15 08:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843150  13 58467 29454837 A  ERRORERROR'
2018-12-15 08:10:54 [DEBUG   ] Got command RPT from MCS: ref #843151
2018-12-15 08:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843151  77 58467 29454838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:10:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:11:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:11:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:11:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:11:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:11:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:11:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:11:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:11:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:11:50 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-12-15 08:11:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 08:12:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:12:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:12:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 08:12:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:12:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:12:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:12:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:12:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:12:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:12:50 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-12-15 08:12:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:13:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:13:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:13:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 08:13:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:13:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:13:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:13:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:13:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:13:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:13:50 [DEBUG   ] Finished updating board flags in 1.774 seconds
2018-12-15 08:13:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:14:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:14:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:14:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 08:14:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:14:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:14:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:14:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:14:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:14:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:14:50 [DEBUG   ] Finished updating board flags in 1.705 seconds
2018-12-15 08:14:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:15:15 [DEBUG   ] Got command RPT from MCS: ref #843175
2018-12-15 08:15:15 [DEBUG   ] summary = ERROR
2018-12-15 08:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843175  13 58467 29715013 A  ERRORERROR'
2018-12-15 08:15:15 [DEBUG   ] Got command RPT from MCS: ref #843176
2018-12-15 08:15:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843176  77 58467 29715205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:15:15 [DEBUG   ] Got command RPT from MCS: ref #843177
2018-12-15 08:15:15 [DEBUG   ] summary = ERROR
2018-12-15 08:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843177  13 58467 29715409 A  ERRORERROR'
2018-12-15 08:15:15 [DEBUG   ] Got command RPT from MCS: ref #843178
2018-12-15 08:15:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843178  77 58467 29715613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:15:15 [DEBUG   ] Got command RPT from MCS: ref #843179
2018-12-15 08:15:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843179  12 58467 29715817 A  ERRORB™™š'
2018-12-15 08:15:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 08:15:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:15:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 08:15:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:15:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:15:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:15:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:15:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:15:50 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-12-15 08:15:54 [DEBUG   ] Got command RPT from MCS: ref #843180
2018-12-15 08:15:54 [DEBUG   ] summary = ERROR
2018-12-15 08:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843180  13 58467 29754841 A  ERRORERROR'
2018-12-15 08:15:54 [DEBUG   ] Got command RPT from MCS: ref #843181
2018-12-15 08:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843181  77 58467 29754842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:15:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 08:16:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:16:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:16:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:16:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:16:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:16:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:16:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:16:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:16:50 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-12-15 08:16:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:17:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 08:17:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:17:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:17:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:17:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:17:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:17:50 [WARNING ] (13, 1, 'bot')
2018-12-15 08:17:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:17:50 [DEBUG   ] Finished updating board flags in 1.543 seconds
2018-12-15 08:17:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:18:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:18:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:18:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:18:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:18:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:18:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:18:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:18:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:18:51 [DEBUG   ] Finished updating board flags in 2.182 seconds
2018-12-15 08:18:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:19:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:19:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:19:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:19:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:19:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:19:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:19:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:19:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:19:51 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-12-15 08:19:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 08:20:15 [DEBUG   ] Got command RPT from MCS: ref #843203
2018-12-15 08:20:15 [DEBUG   ] summary = ERROR
2018-12-15 08:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843203  13 58467 30015093 A  ERRORERROR'
2018-12-15 08:20:15 [DEBUG   ] Got command RPT from MCS: ref #843204
2018-12-15 08:20:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843204  77 58467 30015285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:20:15 [DEBUG   ] Got command RPT from MCS: ref #843205
2018-12-15 08:20:15 [DEBUG   ] summary = ERROR
2018-12-15 08:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843205  13 58467 30015489 A  ERRORERROR'
2018-12-15 08:20:15 [DEBUG   ] Got command RPT from MCS: ref #843207
2018-12-15 08:20:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843207  77 58467 30015693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:20:15 [DEBUG   ] Got command RPT from MCS: ref #843208
2018-12-15 08:20:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:20:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843208  12 58467 30015885 A  ERRORB˜™š'
2018-12-15 08:20:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 08:20:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 08:20:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:20:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:20:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:20:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:20:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:20:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:20:51 [DEBUG   ] Finished updating board flags in 1.938 seconds
2018-12-15 08:20:54 [DEBUG   ] Got command RPT from MCS: ref #843217
2018-12-15 08:20:54 [DEBUG   ] summary = ERROR
2018-12-15 08:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843217  13 58467 30054841 A  ERRORERROR'
2018-12-15 08:20:54 [DEBUG   ] Got command RPT from MCS: ref #843218
2018-12-15 08:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843218  77 58467 30054842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:20:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:21:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 08:21:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:21:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 08:21:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:21:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:21:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:21:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:21:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:21:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:21:51 [DEBUG   ] Finished updating board flags in 1.899 seconds
2018-12-15 08:21:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:22:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:22:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:22:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:22:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:22:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:22:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:22:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:22:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:22:51 [DEBUG   ] Finished updating board flags in 1.701 seconds
2018-12-15 08:22:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:23:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:23:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:23:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 08:23:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:23:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:23:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:23:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:23:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:23:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:23:51 [DEBUG   ] Finished updating board flags in 1.625 seconds
2018-12-15 08:23:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:24:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 08:24:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 08:24:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 08:24:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:24:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 08:24:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:24:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:24:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:24:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:24:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:24:51 [DEBUG   ] Finished updating board flags in 1.578 seconds
2018-12-15 08:24:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 08:25:15 [DEBUG   ] Got command RPT from MCS: ref #843238
2018-12-15 08:25:15 [DEBUG   ] summary = ERROR
2018-12-15 08:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843238  13 58467 30315165 A  ERRORERROR'
2018-12-15 08:25:15 [DEBUG   ] Got command RPT from MCS: ref #843239
2018-12-15 08:25:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843239  77 58467 30315369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:25:15 [DEBUG   ] Got command RPT from MCS: ref #843240
2018-12-15 08:25:15 [DEBUG   ] summary = ERROR
2018-12-15 08:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843240  13 58467 30315573 A  ERRORERROR'
2018-12-15 08:25:15 [DEBUG   ] Got command RPT from MCS: ref #843241
2018-12-15 08:25:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843241  77 58467 30315765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:25:15 [DEBUG   ] Got command RPT from MCS: ref #843242
2018-12-15 08:25:15 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:25:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843242  12 58467 30315969 A  ERRORB˜™š'
2018-12-15 08:25:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 08:25:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 08:25:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 08:25:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:25:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 08:25:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:25:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:25:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:25:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:25:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:25:51 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-12-15 08:25:54 [DEBUG   ] Got command RPT from MCS: ref #843243
2018-12-15 08:25:54 [DEBUG   ] summary = ERROR
2018-12-15 08:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843243  13 58467 30354845 A  ERRORERROR'
2018-12-15 08:25:54 [DEBUG   ] Got command RPT from MCS: ref #843244
2018-12-15 08:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843244  77 58467 30354846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:25:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 08:26:19 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-15 08:26:40 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 08:26:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:26:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:26:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:26:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:26:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:26:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:26:51 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-12-15 08:27:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 08:27:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 08:27:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 08:27:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:27:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:27:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:27:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:27:51 [WARNING ] (13, 1, 'bot')
2018-12-15 08:27:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:27:51 [DEBUG   ] Finished updating board flags in 1.499 seconds
2018-12-15 08:28:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 08:28:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 08:28:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 08:28:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:28:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:28:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:28:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:28:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:28:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:28:52 [DEBUG   ] Finished updating board flags in 2.188 seconds
2018-12-15 08:29:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 08:29:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 08:29:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 08:29:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:29:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:29:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:29:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:29:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:29:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:29:52 [DEBUG   ] Finished updating board flags in 1.928 seconds
2018-12-15 08:30:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 08:30:15 [DEBUG   ] Got command RPT from MCS: ref #843270
2018-12-15 08:30:15 [DEBUG   ] summary = ERROR
2018-12-15 08:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843270  13 58467 30615249 A  ERRORERROR'
2018-12-15 08:30:15 [DEBUG   ] Got command RPT from MCS: ref #843271
2018-12-15 08:30:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843271  77 58467 30615441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:30:15 [DEBUG   ] Got command RPT from MCS: ref #843272
2018-12-15 08:30:15 [DEBUG   ] summary = ERROR
2018-12-15 08:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843272  13 58467 30615646 A  ERRORERROR'
2018-12-15 08:30:15 [DEBUG   ] Got command RPT from MCS: ref #843273
2018-12-15 08:30:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843273  77 58467 30615849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:30:16 [DEBUG   ] Got command RPT from MCS: ref #843275
2018-12-15 08:30:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843275  12 58467 30616045 A  ERRORB˜™š'
2018-12-15 08:30:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 08:30:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:30:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 08:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:30:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 08:30:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:30:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:30:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:30:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:30:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:30:52 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-12-15 08:30:54 [DEBUG   ] Got command RPT from MCS: ref #843280
2018-12-15 08:30:54 [DEBUG   ] summary = ERROR
2018-12-15 08:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843280  13 58467 30654837 A  ERRORERROR'
2018-12-15 08:30:54 [DEBUG   ] Got command RPT from MCS: ref #843281
2018-12-15 08:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843281  77 58467 30654838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:31:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:31:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:31:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:31:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 08:31:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:31:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:31:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:31:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:31:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:31:52 [DEBUG   ] Finished updating board flags in 1.850 seconds
2018-12-15 08:32:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:32:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:32:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:32:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 08:32:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:32:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:32:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:32:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:32:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:32:52 [DEBUG   ] Finished updating board flags in 1.749 seconds
2018-12-15 08:33:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:33:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:33:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:33:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:33:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:33:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:33:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:33:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:33:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:33:52 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-12-15 08:34:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:34:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:34:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:34:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:34:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-15 08:34:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:34:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:34:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:34:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:34:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:34:52 [DEBUG   ] Finished updating board flags in 1.656 seconds
2018-12-15 08:35:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:35:15 [DEBUG   ] Got command RPT from MCS: ref #843301
2018-12-15 08:35:15 [DEBUG   ] summary = ERROR
2018-12-15 08:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843301  13 58467 30915321 A  ERRORERROR'
2018-12-15 08:35:15 [DEBUG   ] Got command RPT from MCS: ref #843302
2018-12-15 08:35:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843302  77 58467 30915525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:35:15 [DEBUG   ] Got command RPT from MCS: ref #843303
2018-12-15 08:35:15 [DEBUG   ] summary = ERROR
2018-12-15 08:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843303  13 58467 30915729 A  ERRORERROR'
2018-12-15 08:35:15 [DEBUG   ] Got command RPT from MCS: ref #843304
2018-12-15 08:35:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:35:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843304  77 58467 30915933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:35:16 [DEBUG   ] Got command RPT from MCS: ref #843305
2018-12-15 08:35:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843305  12 58467 30916125 A  ERRORB™™š'
2018-12-15 08:35:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:35:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:35:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:35:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 08:35:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-15 08:35:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:35:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:35:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:35:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:35:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:35:52 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-15 08:35:54 [DEBUG   ] Got command RPT from MCS: ref #843310
2018-12-15 08:35:54 [DEBUG   ] summary = ERROR
2018-12-15 08:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843310  13 58467 30954841 A  ERRORERROR'
2018-12-15 08:35:54 [DEBUG   ] Got command RPT from MCS: ref #843311
2018-12-15 08:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843311  77 58467 30954842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:36:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:36:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:36:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:36:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:36:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 08:36:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:36:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:36:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:36:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:36:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:36:52 [DEBUG   ] Finished updating board flags in 1.644 seconds
2018-12-15 08:37:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:37:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:37:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:37:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:37:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:37:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:37:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:37:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:37:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:37:52 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-15 08:38:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:38:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:38:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:38:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:38:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 08:38:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:38:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:38:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:38:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:38:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:38:52 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-12-15 08:39:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:39:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:39:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:39:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:39:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:39:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:39:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:39:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:39:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:39:52 [DEBUG   ] Finished updating board flags in 1.647 seconds
2018-12-15 08:40:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:40:15 [DEBUG   ] Got command RPT from MCS: ref #843333
2018-12-15 08:40:15 [DEBUG   ] summary = ERROR
2018-12-15 08:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843333  13 58467 31215413 A  ERRORERROR'
2018-12-15 08:40:15 [DEBUG   ] Got command RPT from MCS: ref #843334
2018-12-15 08:40:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843334  77 58467 31215605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:40:15 [DEBUG   ] Got command RPT from MCS: ref #843335
2018-12-15 08:40:15 [DEBUG   ] summary = ERROR
2018-12-15 08:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843335  13 58467 31215809 A  ERRORERROR'
2018-12-15 08:40:16 [DEBUG   ] Got command RPT from MCS: ref #843337
2018-12-15 08:40:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843337  77 58467 31216013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:40:16 [DEBUG   ] Got command RPT from MCS: ref #843339
2018-12-15 08:40:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843339  12 58467 31216209 A  ERRORB˜™š'
2018-12-15 08:40:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:40:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:40:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 08:40:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:40:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:40:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:40:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:40:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:40:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:40:52 [DEBUG   ] Finished updating board flags in 1.637 seconds
2018-12-15 08:40:54 [DEBUG   ] Got command RPT from MCS: ref #843343
2018-12-15 08:40:54 [DEBUG   ] summary = ERROR
2018-12-15 08:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843343  13 58467 31254837 A  ERRORERROR'
2018-12-15 08:40:54 [DEBUG   ] Got command RPT from MCS: ref #843344
2018-12-15 08:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843344  77 58467 31254838 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:41:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:41:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:41:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:41:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 08:41:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:41:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:41:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:41:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:41:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:41:52 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-12-15 08:42:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:42:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:42:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:42:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:42:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:42:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:42:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:42:52 [WARNING ] (13, 1, 'bot')
2018-12-15 08:42:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:42:52 [DEBUG   ] Finished updating board flags in 1.645 seconds
2018-12-15 08:43:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:43:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:43:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:43:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 08:43:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:43:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:43:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:43:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:43:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:43:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:43:53 [DEBUG   ] Finished updating board flags in 1.641 seconds
2018-12-15 08:44:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:44:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:44:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:44:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:44:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:44:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:44:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:44:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:44:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:44:53 [DEBUG   ] Finished updating board flags in 1.644 seconds
2018-12-15 08:45:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:45:15 [DEBUG   ] Got command RPT from MCS: ref #843368
2018-12-15 08:45:15 [DEBUG   ] summary = ERROR
2018-12-15 08:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843368  13 58467 31515485 A  ERRORERROR'
2018-12-15 08:45:15 [DEBUG   ] Got command RPT from MCS: ref #843369
2018-12-15 08:45:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843369  77 58467 31515693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:45:15 [DEBUG   ] Got command RPT from MCS: ref #843370
2018-12-15 08:45:15 [DEBUG   ] summary = ERROR
2018-12-15 08:45:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843370  13 58467 31515885 A  ERRORERROR'
2018-12-15 08:45:16 [DEBUG   ] Got command RPT from MCS: ref #843371
2018-12-15 08:45:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843371  77 58467 31516089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:45:16 [DEBUG   ] Got command RPT from MCS: ref #843372
2018-12-15 08:45:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843372  12 58467 31516293 A  ERRORB˜™š'
2018-12-15 08:45:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:45:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:45:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:45:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:45:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:45:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:45:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:45:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:45:53 [DEBUG   ] Finished updating board flags in 2.333 seconds
2018-12-15 08:45:54 [DEBUG   ] Got command RPT from MCS: ref #843373
2018-12-15 08:45:54 [DEBUG   ] summary = ERROR
2018-12-15 08:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843373  13 58467 31554849 A  ERRORERROR'
2018-12-15 08:45:54 [DEBUG   ] Got command RPT from MCS: ref #843374
2018-12-15 08:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843374  77 58467 31554850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:46:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:46:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 08:46:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:46:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:46:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 08:46:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-15 08:46:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:46:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:46:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:46:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:46:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:46:53 [DEBUG   ] Finished updating board flags in 2.055 seconds
2018-12-15 08:47:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:47:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:47:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:47:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:47:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-15 08:47:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:47:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:47:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:47:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:47:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:47:53 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-12-15 08:48:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:48:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:48:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:48:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:48:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:48:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:48:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:48:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:48:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:48:53 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-12-15 08:49:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 08:49:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:49:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:49:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 08:49:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:49:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:49:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:49:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:49:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:49:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:49:53 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-12-15 08:50:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:50:15 [DEBUG   ] Got command RPT from MCS: ref #843396
2018-12-15 08:50:15 [DEBUG   ] summary = ERROR
2018-12-15 08:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843396  13 58467 31815561 A  ERRORERROR'
2018-12-15 08:50:15 [DEBUG   ] Got command RPT from MCS: ref #843397
2018-12-15 08:50:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843397  77 58467 31815765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:50:15 [DEBUG   ] Got command RPT from MCS: ref #843398
2018-12-15 08:50:15 [DEBUG   ] summary = ERROR
2018-12-15 08:50:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843398  13 58467 31815969 A  ERRORERROR'
2018-12-15 08:50:16 [DEBUG   ] Got command RPT from MCS: ref #843400
2018-12-15 08:50:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843400  77 58467 31816173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:50:16 [DEBUG   ] Got command RPT from MCS: ref #843401
2018-12-15 08:50:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843401  12 58467 31816365 A  ERRORB™™š'
2018-12-15 08:50:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 08:50:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 08:50:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:50:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:50:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:50:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:50:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:50:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:50:53 [DEBUG   ] Finished updating board flags in 1.857 seconds
2018-12-15 08:50:54 [DEBUG   ] Got command RPT from MCS: ref #843410
2018-12-15 08:50:54 [DEBUG   ] summary = ERROR
2018-12-15 08:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843410  13 58467 31854845 A  ERRORERROR'
2018-12-15 08:50:54 [DEBUG   ] Got command RPT from MCS: ref #843411
2018-12-15 08:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843411  77 58467 31854846 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:51:00 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-12-15 08:51:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 08:51:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 08:51:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:51:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:51:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:51:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:51:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:51:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:51:53 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-12-15 08:52:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 08:52:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 08:52:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 08:52:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:52:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 08:52:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:52:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:52:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:52:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:52:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:52:53 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-12-15 08:53:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 08:53:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 08:53:40 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-15 08:53:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:53:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:53:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:53:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:53:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:53:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:53:53 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-12-15 08:54:01 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 08:54:21 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 08:54:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:54:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:54:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:54:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:54:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:54:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:54:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:54:53 [DEBUG   ] Finished updating board flags in 1.536 seconds
2018-12-15 08:55:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:55:15 [DEBUG   ] Got command RPT from MCS: ref #843431
2018-12-15 08:55:15 [DEBUG   ] summary = ERROR
2018-12-15 08:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843431  13 58467 32115645 A  ERRORERROR'
2018-12-15 08:55:15 [DEBUG   ] Got command RPT from MCS: ref #843432
2018-12-15 08:55:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843432  77 58467 32115849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:55:16 [DEBUG   ] Got command RPT from MCS: ref #843433
2018-12-15 08:55:16 [DEBUG   ] summary = ERROR
2018-12-15 08:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843433  13 58467 32116053 A  ERRORERROR'
2018-12-15 08:55:16 [DEBUG   ] Got command RPT from MCS: ref #843434
2018-12-15 08:55:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843434  77 58467 32116257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:55:16 [DEBUG   ] Got command RPT from MCS: ref #843435
2018-12-15 08:55:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 08:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843435  12 58467 32116449 A  ERRORB˜™š'
2018-12-15 08:55:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:55:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:55:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:55:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:55:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:55:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:55:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:55:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:55:53 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-12-15 08:55:54 [DEBUG   ] Got command RPT from MCS: ref #843436
2018-12-15 08:55:54 [DEBUG   ] summary = ERROR
2018-12-15 08:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843436  13 58467 32154841 A  ERRORERROR'
2018-12-15 08:55:54 [DEBUG   ] Got command RPT from MCS: ref #843437
2018-12-15 08:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 08:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843437  77 58467 32154842 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 08:56:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:56:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:56:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 08:56:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:56:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:56:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:56:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:56:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:56:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:56:53 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-15 08:57:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 08:57:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:57:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 08:57:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:57:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:57:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:57:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:57:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:57:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:57:53 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-15 08:58:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 08:58:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 08:58:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 08:58:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 08:58:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:58:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 08:58:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:58:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:58:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:58:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:58:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:58:53 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-12-15 08:59:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 08:59:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:59:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 08:59:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 08:59:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:59:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:59:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:59:53 [WARNING ] (13, 1, 'bot')
2018-12-15 08:59:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 08:59:53 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-12-15 09:00:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:00:15 [DEBUG   ] Got command RPT from MCS: ref #843463
2018-12-15 09:00:15 [DEBUG   ] summary = ERROR
2018-12-15 09:00:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843463  13 58467 32415733 A  ERRORERROR'
2018-12-15 09:00:15 [DEBUG   ] Got command RPT from MCS: ref #843464
2018-12-15 09:00:15 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:00:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843464  77 58467 32415925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:00:16 [DEBUG   ] Got command RPT from MCS: ref #843465
2018-12-15 09:00:16 [DEBUG   ] summary = ERROR
2018-12-15 09:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843465  13 58467 32416129 A  ERRORERROR'
2018-12-15 09:00:16 [DEBUG   ] Got command RPT from MCS: ref #843467
2018-12-15 09:00:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843467  77 58467 32416333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:00:16 [DEBUG   ] Got command RPT from MCS: ref #843468
2018-12-15 09:00:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843468  12 58467 32416537 A  ERRORB˜™š'
2018-12-15 09:00:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:00:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:00:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:00:53 [WARNING ] (13, 1, 'bot')
2018-12-15 09:00:53 [WARNING ] (13, 1, 'bot')
2018-12-15 09:00:53 [WARNING ] (13, 1, 'bot')
2018-12-15 09:00:53 [WARNING ] (13, 1, 'bot')
2018-12-15 09:00:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:00:53 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-12-15 09:00:54 [DEBUG   ] Got command RPT from MCS: ref #843473
2018-12-15 09:00:54 [DEBUG   ] summary = ERROR
2018-12-15 09:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843473  13 58467 32454849 A  ERRORERROR'
2018-12-15 09:00:54 [DEBUG   ] Got command RPT from MCS: ref #843474
2018-12-15 09:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843474  77 58467 32454850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:01:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:01:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:01:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:01:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:01:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:01:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:01:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:01:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:01:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:01:54 [DEBUG   ] Finished updating board flags in 2.320 seconds
2018-12-15 09:02:01 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 09:02:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 09:02:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 09:02:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:02:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:02:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:02:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:02:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:02:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:02:54 [DEBUG   ] Finished updating board flags in 2.060 seconds
2018-12-15 09:03:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-15 09:03:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 09:03:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 09:03:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:03:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 09:03:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:03:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:03:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:03:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:03:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:03:54 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-12-15 09:04:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 09:04:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-12-15 09:04:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:04:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:04:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:04:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:04:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:04:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:04:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:04:54 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-12-15 09:05:02 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:05:15 [DEBUG   ] Got command RPT from MCS: ref #843494
2018-12-15 09:05:15 [DEBUG   ] summary = ERROR
2018-12-15 09:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843494  13 58467 32715809 A  ERRORERROR'
2018-12-15 09:05:16 [DEBUG   ] Got command RPT from MCS: ref #843495
2018-12-15 09:05:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843495  77 58467 32716013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:05:16 [DEBUG   ] Got command RPT from MCS: ref #843496
2018-12-15 09:05:16 [DEBUG   ] summary = ERROR
2018-12-15 09:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843496  13 58467 32716205 A  ERRORERROR'
2018-12-15 09:05:16 [DEBUG   ] Got command RPT from MCS: ref #843497
2018-12-15 09:05:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843497  77 58467 32716418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:05:16 [DEBUG   ] Got command RPT from MCS: ref #843498
2018-12-15 09:05:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843498  12 58467 32716609 A  ERRORB˜™š'
2018-12-15 09:05:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:05:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 09:05:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 09:05:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:05:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:05:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:05:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:05:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:05:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:05:54 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-12-15 09:05:54 [DEBUG   ] Got command RPT from MCS: ref #843503
2018-12-15 09:05:54 [DEBUG   ] summary = ERROR
2018-12-15 09:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843503  13 58467 32754853 A  ERRORERROR'
2018-12-15 09:05:54 [DEBUG   ] Got command RPT from MCS: ref #843504
2018-12-15 09:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843504  77 58467 32754854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:06:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:06:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:06:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:06:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:06:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:06:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:06:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:06:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:06:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:06:54 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-12-15 09:07:02 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-12-15 09:07:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:07:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:07:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 09:07:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:07:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:07:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:07:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:07:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:07:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:07:54 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-15 09:08:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 09:08:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 09:08:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:08:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:08:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:08:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:08:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:08:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:08:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:08:54 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-15 09:09:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 09:09:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 09:09:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 09:09:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 09:09:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:09:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 09:09:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-15 09:09:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:09:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:09:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:09:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:09:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:09:54 [DEBUG   ] Finished updating board flags in 1.708 seconds
2018-12-15 09:10:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:10:15 [DEBUG   ] Got command RPT from MCS: ref #843526
2018-12-15 09:10:15 [DEBUG   ] summary = ERROR
2018-12-15 09:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843526  13 58467 33015893 A  ERRORERROR'
2018-12-15 09:10:16 [DEBUG   ] Got command RPT from MCS: ref #843527
2018-12-15 09:10:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843527  77 58467 33016085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:10:16 [DEBUG   ] Got command RPT from MCS: ref #843528
2018-12-15 09:10:16 [DEBUG   ] summary = ERROR
2018-12-15 09:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843528  13 58467 33016289 A  ERRORERROR'
2018-12-15 09:10:16 [DEBUG   ] Got command RPT from MCS: ref #843530
2018-12-15 09:10:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843530  77 58467 33016493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:10:16 [DEBUG   ] Got command RPT from MCS: ref #843531
2018-12-15 09:10:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843531  12 58467 33016697 A  ERRORB™™š'
2018-12-15 09:10:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:10:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:10:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:10:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:10:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:10:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:10:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:10:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:10:54 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-12-15 09:10:54 [DEBUG   ] Got command RPT from MCS: ref #843536
2018-12-15 09:10:54 [DEBUG   ] summary = ERROR
2018-12-15 09:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843536  13 58467 33054849 A  ERRORERROR'
2018-12-15 09:10:54 [DEBUG   ] Got command RPT from MCS: ref #843537
2018-12-15 09:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843537  77 58467 33054850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:11:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 09:11:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:11:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:11:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:11:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 09:11:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:11:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:11:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:11:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:11:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:11:54 [DEBUG   ] Finished updating board flags in 1.463 seconds
2018-12-15 09:12:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 09:12:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 09:12:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 09:12:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:12:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:12:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:12:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:12:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:12:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:12:54 [DEBUG   ] Finished updating board flags in 1.476 seconds
2018-12-15 09:13:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:13:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 09:13:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 09:13:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:13:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:13:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:13:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:13:54 [WARNING ] (13, 1, 'bot')
2018-12-15 09:13:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:13:54 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-12-15 09:14:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 09:14:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:14:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 09:14:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:14:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:14:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:14:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:14:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:14:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:14:55 [DEBUG   ] Finished updating board flags in 2.272 seconds
2018-12-15 09:15:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 09:15:15 [DEBUG   ] Got command RPT from MCS: ref #843561
2018-12-15 09:15:15 [DEBUG   ] summary = ERROR
2018-12-15 09:15:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843561  13 58467 33315969 A  ERRORERROR'
2018-12-15 09:15:16 [DEBUG   ] Got command RPT from MCS: ref #843562
2018-12-15 09:15:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843562  77 58467 33316173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:15:16 [DEBUG   ] Got command RPT from MCS: ref #843563
2018-12-15 09:15:16 [DEBUG   ] summary = ERROR
2018-12-15 09:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843563  13 58467 33316365 A  ERRORERROR'
2018-12-15 09:15:16 [DEBUG   ] Got command RPT from MCS: ref #843564
2018-12-15 09:15:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843564  77 58467 33316569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:15:16 [DEBUG   ] Got command RPT from MCS: ref #843565
2018-12-15 09:15:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843565  12 58467 33316773 A  ERRORB˜™š'
2018-12-15 09:15:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 09:15:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:15:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 09:15:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:15:54 [DEBUG   ] Got command RPT from MCS: ref #843566
2018-12-15 09:15:54 [DEBUG   ] summary = ERROR
2018-12-15 09:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843566  13 58467 33354849 A  ERRORERROR'
2018-12-15 09:15:54 [DEBUG   ] Got command RPT from MCS: ref #843567
2018-12-15 09:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843567  77 58467 33354850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:15:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:15:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:15:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:15:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:15:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:15:55 [DEBUG   ] Finished updating board flags in 2.259 seconds
2018-12-15 09:16:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 09:16:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 09:16:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:16:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:16:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:16:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:16:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:16:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:16:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:16:55 [DEBUG   ] Finished updating board flags in 2.073 seconds
2018-12-15 09:17:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 09:17:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:17:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:17:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:17:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:17:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:17:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:17:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:17:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:17:55 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-12-15 09:18:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:18:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:18:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:18:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:18:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:18:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:18:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:18:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:18:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:18:55 [DEBUG   ] Finished updating board flags in 1.993 seconds
2018-12-15 09:19:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:19:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 09:19:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:19:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 09:19:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:19:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:19:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:19:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:19:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:19:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:19:55 [DEBUG   ] Finished updating board flags in 1.824 seconds
2018-12-15 09:20:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:20:16 [DEBUG   ] Got command RPT from MCS: ref #843589
2018-12-15 09:20:16 [DEBUG   ] summary = ERROR
2018-12-15 09:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843589  13 58467 33616045 A  ERRORERROR'
2018-12-15 09:20:16 [DEBUG   ] Got command RPT from MCS: ref #843590
2018-12-15 09:20:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843590  77 58467 33616249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:20:16 [DEBUG   ] Got command RPT from MCS: ref #843591
2018-12-15 09:20:16 [DEBUG   ] summary = ERROR
2018-12-15 09:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843591  13 58467 33616453 A  ERRORERROR'
2018-12-15 09:20:16 [DEBUG   ] Got command RPT from MCS: ref #843593
2018-12-15 09:20:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843593  77 58467 33616657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:20:16 [DEBUG   ] Got command RPT from MCS: ref #843594
2018-12-15 09:20:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:20:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843594  12 58467 33616849 A  ERRORB˜™š'
2018-12-15 09:20:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 09:20:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 09:20:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:20:54 [DEBUG   ] Got command RPT from MCS: ref #843603
2018-12-15 09:20:54 [DEBUG   ] summary = ERROR
2018-12-15 09:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843603  13 58467 33654849 A  ERRORERROR'
2018-12-15 09:20:54 [DEBUG   ] Got command RPT from MCS: ref #843604
2018-12-15 09:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843604  77 58467 33654850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:20:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:20:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:20:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:20:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:20:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:20:55 [DEBUG   ] Finished updating board flags in 1.758 seconds
2018-12-15 09:21:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 09:21:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 09:21:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 09:21:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:21:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:21:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:21:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:21:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:21:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:21:55 [DEBUG   ] Finished updating board flags in 1.652 seconds
2018-12-15 09:22:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 09:22:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 09:22:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 09:22:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 09:22:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:22:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:22:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:22:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:22:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:22:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:22:55 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-15 09:23:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 09:23:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 09:23:42 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-12-15 09:23:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 09:23:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:23:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:23:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:23:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:23:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:23:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:23:55 [DEBUG   ] Finished updating board flags in 1.647 seconds
2018-12-15 09:24:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 09:24:23 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-12-15 09:24:43 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-12-15 09:24:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:24:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:24:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:24:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:24:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:24:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:24:55 [DEBUG   ] Finished updating board flags in 1.497 seconds
2018-12-15 09:25:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:25:16 [DEBUG   ] Got command RPT from MCS: ref #843624
2018-12-15 09:25:16 [DEBUG   ] summary = ERROR
2018-12-15 09:25:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843624  13 58467 33916133 A  ERRORERROR'
2018-12-15 09:25:16 [DEBUG   ] Got command RPT from MCS: ref #843625
2018-12-15 09:25:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:25:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843625  77 58467 33916337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:25:16 [DEBUG   ] Got command RPT from MCS: ref #843626
2018-12-15 09:25:16 [DEBUG   ] summary = ERROR
2018-12-15 09:25:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843626  13 58467 33916541 A  ERRORERROR'
2018-12-15 09:25:16 [DEBUG   ] Got command RPT from MCS: ref #843627
2018-12-15 09:25:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:25:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843627  77 58467 33916733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:25:16 [DEBUG   ] Got command RPT from MCS: ref #843628
2018-12-15 09:25:16 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:25:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843628  12 58467 33916937 A  ERRORB˜™š'
2018-12-15 09:25:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:25:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:25:54 [DEBUG   ] Got command RPT from MCS: ref #843629
2018-12-15 09:25:54 [DEBUG   ] summary = ERROR
2018-12-15 09:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843629  13 58467 33954862 A  ERRORERROR'
2018-12-15 09:25:54 [DEBUG   ] Got command RPT from MCS: ref #843630
2018-12-15 09:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843630  77 58467 33954862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:25:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:25:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 09:25:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:25:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:25:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:25:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:25:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:25:55 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-12-15 09:26:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:26:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 09:26:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:26:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:26:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:26:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:26:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:26:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:26:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:26:55 [DEBUG   ] Finished updating board flags in 1.472 seconds
2018-12-15 09:27:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:27:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:27:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 09:27:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:27:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:27:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:27:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:27:55 [WARNING ] (13, 1, 'bot')
2018-12-15 09:27:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:27:55 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-12-15 09:28:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:28:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:28:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:28:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:28:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:28:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:28:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:28:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:28:56 [DEBUG   ] Finished updating board flags in 2.279 seconds
2018-12-15 09:29:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 09:29:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 09:29:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 09:29:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:29:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:29:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:29:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:29:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:29:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:29:56 [DEBUG   ] Finished updating board flags in 2.102 seconds
2018-12-15 09:30:03 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 09:30:16 [DEBUG   ] Got command RPT from MCS: ref #843656
2018-12-15 09:30:16 [DEBUG   ] summary = ERROR
2018-12-15 09:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843656  13 58467 34216209 A  ERRORERROR'
2018-12-15 09:30:16 [DEBUG   ] Got command RPT from MCS: ref #843657
2018-12-15 09:30:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843657  77 58467 34216413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:30:16 [DEBUG   ] Got command RPT from MCS: ref #843658
2018-12-15 09:30:16 [DEBUG   ] summary = ERROR
2018-12-15 09:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843658  13 58467 34216617 A  ERRORERROR'
2018-12-15 09:30:16 [DEBUG   ] Got command RPT from MCS: ref #843660
2018-12-15 09:30:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:30:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843660  77 58467 34216813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:30:17 [DEBUG   ] Got command RPT from MCS: ref #843661
2018-12-15 09:30:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843661  12 58467 34217017 A  ERRORB˜™š'
2018-12-15 09:30:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:30:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:30:54 [DEBUG   ] Got command RPT from MCS: ref #843666
2018-12-15 09:30:54 [DEBUG   ] summary = ERROR
2018-12-15 09:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843666  13 58467 34254853 A  ERRORERROR'
2018-12-15 09:30:54 [DEBUG   ] Got command RPT from MCS: ref #843667
2018-12-15 09:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843667  77 58467 34254854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:30:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:30:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:30:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:30:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:30:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:30:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:30:56 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-12-15 09:31:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:31:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:31:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:31:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:31:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 09:31:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:31:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:31:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:31:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:31:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:31:56 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-12-15 09:32:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:32:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:32:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:32:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:32:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 09:32:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:32:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:32:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:32:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:32:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:32:56 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-12-15 09:33:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:33:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:33:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:33:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:33:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 09:33:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:33:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:33:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:33:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:33:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:33:56 [DEBUG   ] Finished updating board flags in 1.958 seconds
2018-12-15 09:34:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:34:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:34:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:34:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:34:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:34:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:34:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:34:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:34:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:34:56 [DEBUG   ] Finished updating board flags in 1.882 seconds
2018-12-15 09:35:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:35:16 [DEBUG   ] Got command RPT from MCS: ref #843687
2018-12-15 09:35:16 [DEBUG   ] summary = ERROR
2018-12-15 09:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843687  13 58467 34516293 A  ERRORERROR'
2018-12-15 09:35:16 [DEBUG   ] Got command RPT from MCS: ref #843688
2018-12-15 09:35:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843688  77 58467 34516497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:35:16 [DEBUG   ] Got command RPT from MCS: ref #843689
2018-12-15 09:35:16 [DEBUG   ] summary = ERROR
2018-12-15 09:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843689  13 58467 34516701 A  ERRORERROR'
2018-12-15 09:35:16 [DEBUG   ] Got command RPT from MCS: ref #843690
2018-12-15 09:35:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843690  77 58467 34516893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:35:17 [DEBUG   ] Got command RPT from MCS: ref #843691
2018-12-15 09:35:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:35:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843691  12 58467 34517097 A  ERRORB˜™š'
2018-12-15 09:35:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:35:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:35:54 [DEBUG   ] Got command RPT from MCS: ref #843696
2018-12-15 09:35:54 [DEBUG   ] summary = ERROR
2018-12-15 09:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843696  13 58467 34554853 A  ERRORERROR'
2018-12-15 09:35:54 [DEBUG   ] Got command RPT from MCS: ref #843697
2018-12-15 09:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843697  77 58467 34554854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:35:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 09:35:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:35:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:35:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:35:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:35:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:35:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:35:56 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-15 09:36:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:36:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:36:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:36:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:36:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-15 09:36:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:36:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:36:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:36:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:36:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:36:56 [DEBUG   ] Finished updating board flags in 1.699 seconds
2018-12-15 09:37:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:37:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:37:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:37:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:37:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 09:37:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:37:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:37:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:37:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:37:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:37:56 [DEBUG   ] Finished updating board flags in 1.656 seconds
2018-12-15 09:38:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:38:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 09:38:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:38:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:38:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:38:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:38:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:38:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:38:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:38:56 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-12-15 09:39:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:39:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:39:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 09:39:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:39:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:39:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:39:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:39:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:39:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:39:56 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-12-15 09:40:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:40:16 [DEBUG   ] Got command RPT from MCS: ref #843719
2018-12-15 09:40:16 [DEBUG   ] summary = ERROR
2018-12-15 09:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843719  13 58467 34816373 A  ERRORERROR'
2018-12-15 09:40:16 [DEBUG   ] Got command RPT from MCS: ref #843720
2018-12-15 09:40:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843720  77 58467 34816577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:40:16 [DEBUG   ] Got command RPT from MCS: ref #843721
2018-12-15 09:40:16 [DEBUG   ] summary = ERROR
2018-12-15 09:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843721  13 58467 34816773 A  ERRORERROR'
2018-12-15 09:40:16 [DEBUG   ] Got command RPT from MCS: ref #843723
2018-12-15 09:40:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:40:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843723  77 58467 34816977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:40:17 [DEBUG   ] Got command RPT from MCS: ref #843724
2018-12-15 09:40:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843724  12 58467 34817181 A  ERRORB™™š'
2018-12-15 09:40:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 09:40:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 09:40:54 [DEBUG   ] Got command RPT from MCS: ref #843729
2018-12-15 09:40:54 [DEBUG   ] summary = ERROR
2018-12-15 09:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843729  13 58467 34854861 A  ERRORERROR'
2018-12-15 09:40:54 [DEBUG   ] Got command RPT from MCS: ref #843730
2018-12-15 09:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843730  77 58467 34854862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:40:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:40:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:40:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:40:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:40:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:40:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:40:56 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-12-15 09:41:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 09:41:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 09:41:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 09:41:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:41:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:41:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:41:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:41:56 [WARNING ] (13, 1, 'bot')
2018-12-15 09:41:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:41:56 [DEBUG   ] Finished updating board flags in 1.559 seconds
2018-12-15 09:42:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 09:42:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 09:42:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 09:42:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:42:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:42:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:42:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:42:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:42:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:42:57 [DEBUG   ] Finished updating board flags in 2.162 seconds
2018-12-15 09:43:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 09:43:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 09:43:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 09:43:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:43:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:43:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:43:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:43:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:43:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:43:57 [DEBUG   ] Finished updating board flags in 1.926 seconds
2018-12-15 09:44:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 09:44:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 09:44:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 09:44:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:44:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:44:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:44:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:44:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:44:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:44:57 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-12-15 09:45:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 09:45:16 [DEBUG   ] Got command RPT from MCS: ref #843754
2018-12-15 09:45:16 [DEBUG   ] summary = ERROR
2018-12-15 09:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843754  13 58467 35116453 A  ERRORERROR'
2018-12-15 09:45:16 [DEBUG   ] Got command RPT from MCS: ref #843755
2018-12-15 09:45:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843755  77 58467 35116657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:45:16 [DEBUG   ] Got command RPT from MCS: ref #843756
2018-12-15 09:45:16 [DEBUG   ] summary = ERROR
2018-12-15 09:45:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843756  13 58467 35116861 A  ERRORERROR'
2018-12-15 09:45:17 [DEBUG   ] Got command RPT from MCS: ref #843757
2018-12-15 09:45:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:45:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843757  77 58467 35117054 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:45:17 [DEBUG   ] Got command RPT from MCS: ref #843758
2018-12-15 09:45:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:45:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843758  12 58467 35117258 A  ERRORB˜™š'
2018-12-15 09:45:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 09:45:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 09:45:54 [DEBUG   ] Got command RPT from MCS: ref #843759
2018-12-15 09:45:54 [DEBUG   ] summary = ERROR
2018-12-15 09:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843759  13 58467 35154853 A  ERRORERROR'
2018-12-15 09:45:54 [DEBUG   ] Got command RPT from MCS: ref #843760
2018-12-15 09:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843760  77 58467 35154854 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:45:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:45:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:45:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:45:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:45:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:45:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:45:57 [DEBUG   ] Finished updating board flags in 1.765 seconds
2018-12-15 09:46:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 09:46:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 09:46:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 09:46:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:46:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:46:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:46:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:46:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:46:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:46:57 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-12-15 09:47:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 09:47:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 09:47:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 09:47:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:47:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 09:47:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:47:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:47:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:47:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:47:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:47:57 [DEBUG   ] Finished updating board flags in 1.686 seconds
2018-12-15 09:48:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 09:48:24 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 09:48:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 09:48:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:48:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:48:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:48:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:48:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:48:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:48:57 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-12-15 09:49:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:49:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:49:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:49:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 09:49:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:49:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:49:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:49:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:49:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:49:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:49:57 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-12-15 09:50:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 09:50:16 [DEBUG   ] Got command RPT from MCS: ref #843782
2018-12-15 09:50:16 [DEBUG   ] summary = ERROR
2018-12-15 09:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843782  13 58467 35416541 A  ERRORERROR'
2018-12-15 09:50:16 [DEBUG   ] Got command RPT from MCS: ref #843783
2018-12-15 09:50:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843783  77 58467 35416733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:50:16 [DEBUG   ] Got command RPT from MCS: ref #843784
2018-12-15 09:50:16 [DEBUG   ] summary = ERROR
2018-12-15 09:50:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843784  13 58467 35416937 A  ERRORERROR'
2018-12-15 09:50:17 [DEBUG   ] Got command RPT from MCS: ref #843786
2018-12-15 09:50:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:50:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843786  77 58467 35417141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:50:17 [DEBUG   ] Got command RPT from MCS: ref #843788
2018-12-15 09:50:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:50:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843788  12 58467 35417345 A  ERRORB˜™š'
2018-12-15 09:50:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:50:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:50:54 [DEBUG   ] Got command RPT from MCS: ref #843796
2018-12-15 09:50:54 [DEBUG   ] summary = ERROR
2018-12-15 09:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843796  13 58467 35454861 A  ERRORERROR'
2018-12-15 09:50:54 [DEBUG   ] Got command RPT from MCS: ref #843797
2018-12-15 09:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843797  77 58467 35454862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:50:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:50:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:50:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:50:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:50:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:50:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:50:57 [DEBUG   ] Finished updating board flags in 1.456 seconds
2018-12-15 09:51:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:51:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:51:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:51:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:51:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:51:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:51:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:51:57 [WARNING ] (13, 1, 'bot')
2018-12-15 09:51:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:51:57 [DEBUG   ] Finished updating board flags in 1.502 seconds
2018-12-15 09:52:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:52:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:52:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:52:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:52:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:52:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:52:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:52:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:52:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:52:58 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-12-15 09:53:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:53:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:53:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:53:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:53:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:53:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:53:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:53:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:53:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:53:58 [DEBUG   ] Finished updating board flags in 2.160 seconds
2018-12-15 09:54:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 09:54:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:54:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:54:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:54:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:54:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:54:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:54:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:54:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:54:58 [DEBUG   ] Finished updating board flags in 1.926 seconds
2018-12-15 09:55:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:55:16 [DEBUG   ] Got command RPT from MCS: ref #843817
2018-12-15 09:55:16 [DEBUG   ] summary = ERROR
2018-12-15 09:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843817  13 58467 35716613 A  ERRORERROR'
2018-12-15 09:55:16 [DEBUG   ] Got command RPT from MCS: ref #843818
2018-12-15 09:55:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843818  77 58467 35716817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:55:17 [DEBUG   ] Got command RPT from MCS: ref #843819
2018-12-15 09:55:17 [DEBUG   ] summary = ERROR
2018-12-15 09:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843819  13 58467 35717021 A  ERRORERROR'
2018-12-15 09:55:17 [DEBUG   ] Got command RPT from MCS: ref #843820
2018-12-15 09:55:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843820  77 58467 35717225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:55:17 [DEBUG   ] Got command RPT from MCS: ref #843821
2018-12-15 09:55:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 09:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843821  12 58467 35717417 A  ERRORB˜™š'
2018-12-15 09:55:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 09:55:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:55:54 [DEBUG   ] Got command RPT from MCS: ref #843822
2018-12-15 09:55:54 [DEBUG   ] summary = ERROR
2018-12-15 09:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843822  13 58467 35754857 A  ERRORERROR'
2018-12-15 09:55:54 [DEBUG   ] Got command RPT from MCS: ref #843823
2018-12-15 09:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 09:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843823  77 58467 35754858 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 09:55:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:55:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:55:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:55:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:55:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:55:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:55:58 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-12-15 09:56:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:56:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:56:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:56:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:56:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:56:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:56:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:56:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:56:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:56:58 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-15 09:57:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:57:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:57:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:57:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:57:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:57:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:57:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:57:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:57:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:57:58 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-12-15 09:58:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:58:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:58:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 09:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:58:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:58:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:58:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:58:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:58:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:58:58 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-12-15 09:59:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 09:59:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:59:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 09:59:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 09:59:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 09:59:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:59:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:59:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:59:58 [WARNING ] (13, 1, 'bot')
2018-12-15 09:59:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 09:59:58 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-12-15 10:00:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:00:16 [DEBUG   ] Got command RPT from MCS: ref #843849
2018-12-15 10:00:16 [DEBUG   ] summary = ERROR
2018-12-15 10:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843849  13 58467 36016697 A  ERRORERROR'
2018-12-15 10:00:16 [DEBUG   ] Got command RPT from MCS: ref #843850
2018-12-15 10:00:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:00:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843850  77 58467 36016901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:00:17 [DEBUG   ] Got command RPT from MCS: ref #843851
2018-12-15 10:00:17 [DEBUG   ] summary = ERROR
2018-12-15 10:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843851  13 58467 36017106 A  ERRORERROR'
2018-12-15 10:00:17 [DEBUG   ] Got command RPT from MCS: ref #843853
2018-12-15 10:00:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843853  77 58467 36017297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:00:17 [DEBUG   ] Got command RPT from MCS: ref #843855
2018-12-15 10:00:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843855  12 58467 36017501 A  ERRORB™™š'
2018-12-15 10:00:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:00:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:00:54 [DEBUG   ] Got command RPT from MCS: ref #843859
2018-12-15 10:00:54 [DEBUG   ] summary = ERROR
2018-12-15 10:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843859  13 58467 36054861 A  ERRORERROR'
2018-12-15 10:00:54 [DEBUG   ] Got command RPT from MCS: ref #843860
2018-12-15 10:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843860  77 58467 36054862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:00:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:00:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:00:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:00:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:00:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:00:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:00:59 [DEBUG   ] Finished updating board flags in 2.255 seconds
2018-12-15 10:01:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:01:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:01:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:01:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:01:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:01:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:01:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:01:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:01:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:01:59 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-12-15 10:02:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:02:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:02:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:02:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:02:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 10:02:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:02:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:02:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:02:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:02:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:02:59 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-12-15 10:03:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:03:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:03:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:03:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 10:03:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:03:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:03:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:03:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:03:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:03:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:03:59 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-12-15 10:04:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:04:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:04:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:04:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:04:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:04:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:04:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:04:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:04:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:04:59 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-12-15 10:05:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:05:16 [DEBUG   ] Got command RPT from MCS: ref #843880
2018-12-15 10:05:16 [DEBUG   ] summary = ERROR
2018-12-15 10:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843880  13 58467 36316781 A  ERRORERROR'
2018-12-15 10:05:16 [DEBUG   ] Got command RPT from MCS: ref #843881
2018-12-15 10:05:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843881  77 58467 36316985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:05:17 [DEBUG   ] Got command RPT from MCS: ref #843882
2018-12-15 10:05:17 [DEBUG   ] summary = ERROR
2018-12-15 10:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843882  13 58467 36317189 A  ERRORERROR'
2018-12-15 10:05:17 [DEBUG   ] Got command RPT from MCS: ref #843883
2018-12-15 10:05:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843883  77 58467 36317381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:05:17 [DEBUG   ] Got command RPT from MCS: ref #843884
2018-12-15 10:05:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843884  12 58467 36317585 A  ERRORB™™š'
2018-12-15 10:05:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:05:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:05:54 [DEBUG   ] Got command RPT from MCS: ref #843889
2018-12-15 10:05:54 [DEBUG   ] summary = ERROR
2018-12-15 10:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843889  13 58467 36354861 A  ERRORERROR'
2018-12-15 10:05:54 [DEBUG   ] Got command RPT from MCS: ref #843890
2018-12-15 10:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843890  77 58467 36354862 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:05:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:05:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:05:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:05:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:05:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:05:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:05:59 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-12-15 10:06:04 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 10:06:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 10:06:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:06:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:06:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 10:06:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:06:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:06:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:06:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:06:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:06:59 [DEBUG   ] Finished updating board flags in 1.767 seconds
2018-12-15 10:07:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:07:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:07:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:07:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 10:07:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:07:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:07:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:07:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:07:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:07:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:07:59 [DEBUG   ] Finished updating board flags in 1.722 seconds
2018-12-15 10:08:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:08:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:08:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 10:08:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:08:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:08:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:08:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:08:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:08:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:08:59 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-15 10:09:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:09:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:09:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:09:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 10:09:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:09:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:09:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:09:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:09:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:09:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:09:59 [DEBUG   ] Finished updating board flags in 1.469 seconds
2018-12-15 10:10:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 10:10:16 [DEBUG   ] Got command RPT from MCS: ref #843912
2018-12-15 10:10:16 [DEBUG   ] summary = ERROR
2018-12-15 10:10:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843912  13 58467 36616861 A  ERRORERROR'
2018-12-15 10:10:17 [DEBUG   ] Got command RPT from MCS: ref #843913
2018-12-15 10:10:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:10:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843913  77 58467 36617065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:10:17 [DEBUG   ] Got command RPT from MCS: ref #843914
2018-12-15 10:10:17 [DEBUG   ] summary = ERROR
2018-12-15 10:10:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843914  13 58467 36617257 A  ERRORERROR'
2018-12-15 10:10:17 [DEBUG   ] Got command RPT from MCS: ref #843916
2018-12-15 10:10:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:10:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843916  77 58467 36617461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:10:17 [DEBUG   ] Got command RPT from MCS: ref #843917
2018-12-15 10:10:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:10:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843917  12 58467 36617665 A  ERRORB˜™š'
2018-12-15 10:10:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:10:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:10:54 [DEBUG   ] Got command RPT from MCS: ref #843922
2018-12-15 10:10:54 [DEBUG   ] summary = ERROR
2018-12-15 10:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843922  13 58467 36654865 A  ERRORERROR'
2018-12-15 10:10:54 [DEBUG   ] Got command RPT from MCS: ref #843923
2018-12-15 10:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843923  77 58467 36654866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:10:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:10:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 10:10:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:10:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:10:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:10:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:10:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:10:59 [DEBUG   ] Finished updating board flags in 1.457 seconds
2018-12-15 10:11:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:11:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:11:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:11:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:11:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:11:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:11:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:11:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:11:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:11:59 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-12-15 10:12:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:12:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:12:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 10:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 10:12:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:12:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 10:12:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:12:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:12:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:12:59 [WARNING ] (13, 1, 'bot')
2018-12-15 10:12:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:12:59 [DEBUG   ] Finished updating board flags in 1.505 seconds
2018-12-15 10:13:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:13:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:13:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 10:13:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:14:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:14:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:14:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:14:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:14:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:14:00 [DEBUG   ] Finished updating board flags in 2.257 seconds
2018-12-15 10:14:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 10:14:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 10:14:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 10:14:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:15:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:15:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:15:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:15:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:15:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:15:00 [DEBUG   ] Finished updating board flags in 2.091 seconds
2018-12-15 10:15:04 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-15 10:15:16 [DEBUG   ] Got command RPT from MCS: ref #843947
2018-12-15 10:15:16 [DEBUG   ] summary = ERROR
2018-12-15 10:15:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843947  13 58467 36916945 A  ERRORERROR'
2018-12-15 10:15:17 [DEBUG   ] Got command RPT from MCS: ref #843948
2018-12-15 10:15:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843948  77 58467 36917137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:15:17 [DEBUG   ] Got command RPT from MCS: ref #843949
2018-12-15 10:15:17 [DEBUG   ] summary = ERROR
2018-12-15 10:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843949  13 58467 36917341 A  ERRORERROR'
2018-12-15 10:15:17 [DEBUG   ] Got command RPT from MCS: ref #843950
2018-12-15 10:15:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843950  77 58467 36917545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:15:17 [DEBUG   ] Got command RPT from MCS: ref #843951
2018-12-15 10:15:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843951  12 58467 36917749 A  ERRORB˜™š'
2018-12-15 10:15:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 10:15:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 10:15:54 [DEBUG   ] Got command RPT from MCS: ref #843952
2018-12-15 10:15:54 [DEBUG   ] summary = ERROR
2018-12-15 10:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843952  13 58467 36954865 A  ERRORERROR'
2018-12-15 10:15:54 [DEBUG   ] Got command RPT from MCS: ref #843953
2018-12-15 10:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843953  77 58467 36954866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:15:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:16:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:16:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:16:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:16:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:16:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:16:00 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-12-15 10:16:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:16:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 10:16:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 10:16:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:17:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:17:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:17:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:17:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:17:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:17:00 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-12-15 10:17:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:17:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 10:17:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:17:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:18:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:18:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:18:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:18:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:18:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:18:00 [DEBUG   ] Finished updating board flags in 1.948 seconds
2018-12-15 10:18:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 10:18:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 10:18:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:18:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:19:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:19:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:19:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:19:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:19:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:19:00 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-15 10:19:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:19:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 10:19:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 10:19:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:20:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:20:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:20:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:20:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:20:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:20:00 [DEBUG   ] Finished updating board flags in 1.878 seconds
2018-12-15 10:20:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 10:20:17 [DEBUG   ] Got command RPT from MCS: ref #843975
2018-12-15 10:20:17 [DEBUG   ] summary = ERROR
2018-12-15 10:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843975  13 58467 37217025 A  ERRORERROR'
2018-12-15 10:20:17 [DEBUG   ] Got command RPT from MCS: ref #843976
2018-12-15 10:20:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843976  77 58467 37217217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:20:17 [DEBUG   ] Got command RPT from MCS: ref #843977
2018-12-15 10:20:17 [DEBUG   ] summary = ERROR
2018-12-15 10:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843977  13 58467 37217421 A  ERRORERROR'
2018-12-15 10:20:17 [DEBUG   ] Got command RPT from MCS: ref #843979
2018-12-15 10:20:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843979  77 58467 37217625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:20:17 [DEBUG   ] Got command RPT from MCS: ref #843981
2018-12-15 10:20:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843981  12 58467 37217829 A  ERRORB˜™š'
2018-12-15 10:20:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:20:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 10:20:54 [DEBUG   ] Got command RPT from MCS: ref #843989
2018-12-15 10:20:54 [DEBUG   ] summary = ERROR
2018-12-15 10:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843989  13 58467 37254869 A  ERRORERROR'
2018-12-15 10:20:54 [DEBUG   ] Got command RPT from MCS: ref #843990
2018-12-15 10:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   843990  77 58467 37254870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:20:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:21:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:21:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:21:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:21:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:21:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:21:00 [DEBUG   ] Finished updating board flags in 1.738 seconds
2018-12-15 10:21:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:21:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:21:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 10:21:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:22:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:22:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:22:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:22:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:22:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:22:00 [DEBUG   ] Finished updating board flags in 1.657 seconds
2018-12-15 10:22:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 10:22:25 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 10:22:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 10:22:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:23:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:23:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:23:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:23:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:23:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:23:00 [DEBUG   ] Finished updating board flags in 1.524 seconds
2018-12-15 10:23:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:23:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:23:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:23:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:24:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:24:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:24:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:24:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:24:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:24:00 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-12-15 10:24:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 10:24:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 10:24:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:25:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:25:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:25:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:25:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:25:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:25:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:25:00 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-12-15 10:25:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:25:17 [DEBUG   ] Got command RPT from MCS: ref #844010
2018-12-15 10:25:17 [DEBUG   ] summary = ERROR
2018-12-15 10:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844010  13 58467 37517104 A  ERRORERROR'
2018-12-15 10:25:17 [DEBUG   ] Got command RPT from MCS: ref #844011
2018-12-15 10:25:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844011  77 58467 37517305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:25:17 [DEBUG   ] Got command RPT from MCS: ref #844012
2018-12-15 10:25:17 [DEBUG   ] summary = ERROR
2018-12-15 10:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844012  13 58467 37517509 A  ERRORERROR'
2018-12-15 10:25:17 [DEBUG   ] Got command RPT from MCS: ref #844013
2018-12-15 10:25:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844013  77 58467 37517701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:25:17 [DEBUG   ] Got command RPT from MCS: ref #844014
2018-12-15 10:25:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:25:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844014  12 58467 37517905 A  ERRORB—™š'
2018-12-15 10:25:25 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-15 10:25:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 10:25:54 [DEBUG   ] Got command RPT from MCS: ref #844015
2018-12-15 10:25:54 [DEBUG   ] summary = ERROR
2018-12-15 10:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844015  13 58467 37554865 A  ERRORERROR'
2018-12-15 10:25:54 [DEBUG   ] Got command RPT from MCS: ref #844016
2018-12-15 10:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844016  77 58467 37554866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:26:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:26:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:26:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:26:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:26:00 [WARNING ] (13, 1, 'bot')
2018-12-15 10:26:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:26:00 [DEBUG   ] Finished updating board flags in 1.480 seconds
2018-12-15 10:26:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 10:26:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 10:26:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 10:27:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:27:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:27:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:27:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:27:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:27:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:27:01 [DEBUG   ] Finished updating board flags in 2.222 seconds
2018-12-15 10:27:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 10:27:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 10:27:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 10:28:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:28:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:28:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:28:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:28:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:28:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:28:01 [DEBUG   ] Finished updating board flags in 2.144 seconds
2018-12-15 10:28:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 10:28:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 10:28:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 10:29:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:29:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:29:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:29:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:29:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:29:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:29:01 [DEBUG   ] Finished updating board flags in 2.062 seconds
2018-12-15 10:29:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 10:29:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:29:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 10:30:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:30:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:30:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:30:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:30:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:30:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:30:01 [DEBUG   ] Finished updating board flags in 1.943 seconds
2018-12-15 10:30:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 10:30:17 [DEBUG   ] Got command RPT from MCS: ref #844042
2018-12-15 10:30:17 [DEBUG   ] summary = ERROR
2018-12-15 10:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844042  13 58467 37817185 A  ERRORERROR'
2018-12-15 10:30:17 [DEBUG   ] Got command RPT from MCS: ref #844043
2018-12-15 10:30:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844043  77 58467 37817389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:30:17 [DEBUG   ] Got command RPT from MCS: ref #844044
2018-12-15 10:30:17 [DEBUG   ] summary = ERROR
2018-12-15 10:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844044  13 58467 37817581 A  ERRORERROR'
2018-12-15 10:30:17 [DEBUG   ] Got command RPT from MCS: ref #844046
2018-12-15 10:30:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844046  77 58467 37817785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:30:17 [DEBUG   ] Got command RPT from MCS: ref #844047
2018-12-15 10:30:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:30:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844047  12 58467 37817989 A  ERRORB˜™š'
2018-12-15 10:30:26 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 10:30:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 10:30:54 [DEBUG   ] Got command RPT from MCS: ref #844052
2018-12-15 10:30:54 [DEBUG   ] summary = ERROR
2018-12-15 10:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844052  13 58467 37854865 A  ERRORERROR'
2018-12-15 10:30:54 [DEBUG   ] Got command RPT from MCS: ref #844053
2018-12-15 10:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844053  77 58467 37854866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:31:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:31:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:31:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:31:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:31:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:31:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:31:01 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-12-15 10:31:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:31:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:31:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:32:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:32:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:32:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:32:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:32:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:32:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:32:01 [DEBUG   ] Finished updating board flags in 1.596 seconds
2018-12-15 10:32:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 10:32:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:32:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:33:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 10:33:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:33:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:33:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:33:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:33:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:33:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:33:01 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-12-15 10:33:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:33:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 10:33:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:34:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:34:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 10:34:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:34:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:34:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:34:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:34:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:34:01 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-12-15 10:34:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:34:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:34:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 10:35:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 10:35:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:35:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 10:35:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:35:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:35:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:35:01 [WARNING ] (13, 1, 'bot')
2018-12-15 10:35:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:35:01 [DEBUG   ] Finished updating board flags in 1.569 seconds
2018-12-15 10:35:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 10:35:17 [DEBUG   ] Got command RPT from MCS: ref #844073
2018-12-15 10:35:17 [DEBUG   ] summary = ERROR
2018-12-15 10:35:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844073  13 58467 38117261 A  ERRORERROR'
2018-12-15 10:35:17 [DEBUG   ] Got command RPT from MCS: ref #844074
2018-12-15 10:35:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:35:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844074  77 58467 38117465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:35:17 [DEBUG   ] Got command RPT from MCS: ref #844075
2018-12-15 10:35:17 [DEBUG   ] summary = ERROR
2018-12-15 10:35:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844075  13 58467 38117669 A  ERRORERROR'
2018-12-15 10:35:17 [DEBUG   ] Got command RPT from MCS: ref #844076
2018-12-15 10:35:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:35:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844076  77 58467 38117873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:35:18 [DEBUG   ] Got command RPT from MCS: ref #844077
2018-12-15 10:35:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844077  12 58467 38118065 A  ERRORB˜™š'
2018-12-15 10:35:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:35:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:35:54 [DEBUG   ] Got command RPT from MCS: ref #844082
2018-12-15 10:35:54 [DEBUG   ] summary = ERROR
2018-12-15 10:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844082  13 58467 38154873 A  ERRORERROR'
2018-12-15 10:35:54 [DEBUG   ] Got command RPT from MCS: ref #844083
2018-12-15 10:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844083  77 58467 38154874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:36:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:36:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:36:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:36:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:36:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:36:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:36:02 [DEBUG   ] Finished updating board flags in 2.303 seconds
2018-12-15 10:36:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 10:36:26 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-15 10:36:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 10:37:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:37:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 10:37:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 10:37:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:37:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:37:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:37:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:37:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:37:02 [DEBUG   ] Finished updating board flags in 2.098 seconds
2018-12-15 10:37:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 10:37:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 10:37:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 10:38:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:38:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:38:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:38:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:38:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:38:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:38:02 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-12-15 10:38:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 10:38:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 10:38:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 10:39:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:39:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:39:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:39:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:39:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:39:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:39:02 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-12-15 10:39:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 10:39:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 10:39:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 10:40:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:40:02 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 10:40:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:40:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:40:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:40:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:40:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:40:02 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-12-15 10:40:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 10:40:17 [DEBUG   ] Got command RPT from MCS: ref #844105
2018-12-15 10:40:17 [DEBUG   ] summary = ERROR
2018-12-15 10:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844105  13 58467 38417341 A  ERRORERROR'
2018-12-15 10:40:17 [DEBUG   ] Got command RPT from MCS: ref #844106
2018-12-15 10:40:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844106  77 58467 38417545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:40:17 [DEBUG   ] Got command RPT from MCS: ref #844107
2018-12-15 10:40:17 [DEBUG   ] summary = ERROR
2018-12-15 10:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844107  13 58467 38417749 A  ERRORERROR'
2018-12-15 10:40:17 [DEBUG   ] Got command RPT from MCS: ref #844109
2018-12-15 10:40:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:40:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844109  77 58467 38417953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:40:18 [DEBUG   ] Got command RPT from MCS: ref #844111
2018-12-15 10:40:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844111  12 58467 38418145 A  ERRORB˜™š'
2018-12-15 10:40:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 10:40:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 10:40:54 [DEBUG   ] Got command RPT from MCS: ref #844115
2018-12-15 10:40:54 [DEBUG   ] summary = ERROR
2018-12-15 10:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844115  13 58467 38454865 A  ERRORERROR'
2018-12-15 10:40:54 [DEBUG   ] Got command RPT from MCS: ref #844116
2018-12-15 10:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844116  77 58467 38454866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:41:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:41:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:41:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:41:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:41:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:41:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:41:02 [DEBUG   ] Finished updating board flags in 1.965 seconds
2018-12-15 10:41:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 10:41:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-15 10:41:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 10:42:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:42:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:42:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:42:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:42:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:42:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:42:02 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-12-15 10:42:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-12-15 10:42:27 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 10:42:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 10:43:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:43:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:43:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:43:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:43:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:43:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:43:02 [DEBUG   ] Finished updating board flags in 1.772 seconds
2018-12-15 10:43:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:43:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 10:43:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:44:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:44:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:44:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:44:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:44:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:44:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:44:02 [DEBUG   ] Finished updating board flags in 1.705 seconds
2018-12-15 10:44:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:44:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:44:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:45:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:45:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:45:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:45:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:45:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:45:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:45:02 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-12-15 10:45:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:45:17 [DEBUG   ] Got command RPT from MCS: ref #844140
2018-12-15 10:45:17 [DEBUG   ] summary = ERROR
2018-12-15 10:45:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844140  13 58467 38717425 A  ERRORERROR'
2018-12-15 10:45:17 [DEBUG   ] Got command RPT from MCS: ref #844141
2018-12-15 10:45:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:45:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844141  77 58467 38717629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:45:17 [DEBUG   ] Got command RPT from MCS: ref #844142
2018-12-15 10:45:17 [DEBUG   ] summary = ERROR
2018-12-15 10:45:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844142  13 58467 38717833 A  ERRORERROR'
2018-12-15 10:45:18 [DEBUG   ] Got command RPT from MCS: ref #844143
2018-12-15 10:45:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844143  77 58467 38718037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:45:18 [DEBUG   ] Got command RPT from MCS: ref #844144
2018-12-15 10:45:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844144  12 58467 38718229 A  ERRORB˜™š'
2018-12-15 10:45:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:45:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:45:54 [DEBUG   ] Got command RPT from MCS: ref #844145
2018-12-15 10:45:54 [DEBUG   ] summary = ERROR
2018-12-15 10:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844145  13 58467 38754865 A  ERRORERROR'
2018-12-15 10:45:54 [DEBUG   ] Got command RPT from MCS: ref #844146
2018-12-15 10:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844146  77 58467 38754866 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:46:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:46:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:46:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:46:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:46:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:46:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:46:02 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-12-15 10:46:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:46:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:46:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 10:47:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:47:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 10:47:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:47:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:47:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:47:02 [WARNING ] (13, 1, 'bot')
2018-12-15 10:47:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:47:02 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-12-15 10:47:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:47:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 10:47:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:48:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:48:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:48:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:48:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:48:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:48:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:48:03 [DEBUG   ] Finished updating board flags in 2.223 seconds
2018-12-15 10:48:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:48:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:48:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 10:49:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:49:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:49:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:49:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:49:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:49:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:49:03 [DEBUG   ] Finished updating board flags in 2.251 seconds
2018-12-15 10:49:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:49:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:49:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:50:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:50:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-15 10:50:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:50:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:50:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:50:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:50:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:50:03 [DEBUG   ] Finished updating board flags in 2.163 seconds
2018-12-15 10:50:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 10:50:17 [DEBUG   ] Got command RPT from MCS: ref #844168
2018-12-15 10:50:17 [DEBUG   ] summary = ERROR
2018-12-15 10:50:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844168  13 58467 39017506 A  ERRORERROR'
2018-12-15 10:50:17 [DEBUG   ] Got command RPT from MCS: ref #844169
2018-12-15 10:50:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:50:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844169  77 58467 39017709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:50:17 [DEBUG   ] Got command RPT from MCS: ref #844170
2018-12-15 10:50:17 [DEBUG   ] summary = ERROR
2018-12-15 10:50:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844170  13 58467 39017914 A  ERRORERROR'
2018-12-15 10:50:18 [DEBUG   ] Got command RPT from MCS: ref #844172
2018-12-15 10:50:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844172  77 58467 39018118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:50:18 [DEBUG   ] Got command RPT from MCS: ref #844174
2018-12-15 10:50:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844174  12 58467 39018309 A  ERRORB˜™š'
2018-12-15 10:50:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 10:50:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:50:54 [DEBUG   ] Got command RPT from MCS: ref #844182
2018-12-15 10:50:54 [DEBUG   ] summary = ERROR
2018-12-15 10:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844182  13 58467 39054873 A  ERRORERROR'
2018-12-15 10:50:54 [DEBUG   ] Got command RPT from MCS: ref #844183
2018-12-15 10:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844183  77 58467 39054874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:51:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:51:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:51:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:51:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:51:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:51:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:51:03 [DEBUG   ] Finished updating board flags in 1.963 seconds
2018-12-15 10:51:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:51:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 10:51:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:52:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:52:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:52:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:52:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:52:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:52:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:52:03 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-12-15 10:52:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:52:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 10:52:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 10:53:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 10:53:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:53:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:53:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:53:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:53:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:53:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:53:03 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-12-15 10:53:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 10:53:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 10:53:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 10:54:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:54:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:54:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:54:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:54:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:54:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:54:03 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-12-15 10:54:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 10:54:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 10:54:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:55:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:55:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:55:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:55:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:55:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:55:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:55:03 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-12-15 10:55:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 10:55:17 [DEBUG   ] Got command RPT from MCS: ref #844203
2018-12-15 10:55:17 [DEBUG   ] summary = ERROR
2018-12-15 10:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844203  13 58467 39317593 A  ERRORERROR'
2018-12-15 10:55:17 [DEBUG   ] Got command RPT from MCS: ref #844204
2018-12-15 10:55:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844204  77 58467 39317797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:55:17 [DEBUG   ] Got command RPT from MCS: ref #844205
2018-12-15 10:55:17 [DEBUG   ] summary = ERROR
2018-12-15 10:55:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844205  13 58467 39317989 A  ERRORERROR'
2018-12-15 10:55:18 [DEBUG   ] Got command RPT from MCS: ref #844206
2018-12-15 10:55:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844206  77 58467 39318193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:55:18 [DEBUG   ] Got command RPT from MCS: ref #844207
2018-12-15 10:55:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 10:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844207  12 58467 39318397 A  ERRORB˜™š'
2018-12-15 10:55:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 10:55:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 10:55:54 [DEBUG   ] Got command RPT from MCS: ref #844208
2018-12-15 10:55:54 [DEBUG   ] summary = ERROR
2018-12-15 10:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844208  13 58467 39354869 A  ERRORERROR'
2018-12-15 10:55:54 [DEBUG   ] Got command RPT from MCS: ref #844209
2018-12-15 10:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 10:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844209  77 58467 39354870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 10:56:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:56:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 10:56:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:56:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:56:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:56:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:56:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:56:03 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-12-15 10:56:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 10:56:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 10:56:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 10:57:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:57:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 10:57:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:57:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:57:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:57:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:57:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:57:03 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-12-15 10:57:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 10:57:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:57:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:58:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:58:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 10:58:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:58:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:58:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:58:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:58:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:58:03 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-12-15 10:58:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:58:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 10:58:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 10:59:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 10:59:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 10:59:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:59:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:59:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:59:03 [WARNING ] (13, 1, 'bot')
2018-12-15 10:59:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 10:59:03 [DEBUG   ] Finished updating board flags in 1.523 seconds
2018-12-15 10:59:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:59:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 10:59:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:00:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:00:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:00:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:00:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:00:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:00:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:00:04 [DEBUG   ] Finished updating board flags in 2.198 seconds
2018-12-15 11:00:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:00:17 [DEBUG   ] Got command RPT from MCS: ref #844235
2018-12-15 11:00:17 [DEBUG   ] summary = ERROR
2018-12-15 11:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844235  13 58467 39617673 A  ERRORERROR'
2018-12-15 11:00:17 [DEBUG   ] Got command RPT from MCS: ref #844236
2018-12-15 11:00:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:00:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844236  77 58467 39617865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:00:18 [DEBUG   ] Got command RPT from MCS: ref #844237
2018-12-15 11:00:18 [DEBUG   ] summary = ERROR
2018-12-15 11:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844237  13 58467 39618069 A  ERRORERROR'
2018-12-15 11:00:18 [DEBUG   ] Got command RPT from MCS: ref #844239
2018-12-15 11:00:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844239  77 58467 39618273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:00:18 [DEBUG   ] Got command RPT from MCS: ref #844240
2018-12-15 11:00:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844240  12 58467 39618477 A  ERRORB™™š'
2018-12-15 11:00:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 11:00:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:00:54 [DEBUG   ] Got command RPT from MCS: ref #844245
2018-12-15 11:00:54 [DEBUG   ] summary = ERROR
2018-12-15 11:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844245  13 58467 39654877 A  ERRORERROR'
2018-12-15 11:00:54 [DEBUG   ] Got command RPT from MCS: ref #844246
2018-12-15 11:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844246  77 58467 39654878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:01:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:01:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:01:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:01:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:01:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:01:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:01:04 [DEBUG   ] Finished updating board flags in 1.883 seconds
2018-12-15 11:01:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:01:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:01:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 11:02:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:02:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:02:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:02:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:02:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:02:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:02:04 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-12-15 11:02:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:02:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 11:02:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:03:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:03:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:03:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:03:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:03:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:03:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:03:04 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-12-15 11:03:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 11:03:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 11:03:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:04:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:04:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 11:04:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:04:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:04:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:04:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:04:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:04:04 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-12-15 11:04:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 11:04:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 11:04:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 11:05:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:05:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:05:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:05:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:05:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:05:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:05:04 [DEBUG   ] Finished updating board flags in 1.667 seconds
2018-12-15 11:05:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 11:05:17 [DEBUG   ] Got command RPT from MCS: ref #844266
2018-12-15 11:05:17 [DEBUG   ] summary = ERROR
2018-12-15 11:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844266  13 58467 39917749 A  ERRORERROR'
2018-12-15 11:05:17 [DEBUG   ] Got command RPT from MCS: ref #844267
2018-12-15 11:05:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:05:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844267  77 58467 39917953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:05:18 [DEBUG   ] Got command RPT from MCS: ref #844268
2018-12-15 11:05:18 [DEBUG   ] summary = ERROR
2018-12-15 11:05:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844268  13 58467 39918145 A  ERRORERROR'
2018-12-15 11:05:18 [DEBUG   ] Got command RPT from MCS: ref #844269
2018-12-15 11:05:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:05:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844269  77 58467 39918349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:05:18 [DEBUG   ] Got command RPT from MCS: ref #844270
2018-12-15 11:05:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:05:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844270  12 58467 39918553 A  ERRORB˜™š'
2018-12-15 11:05:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:05:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 11:05:54 [DEBUG   ] Got command RPT from MCS: ref #844275
2018-12-15 11:05:54 [DEBUG   ] summary = ERROR
2018-12-15 11:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844275  13 58467 39954869 A  ERRORERROR'
2018-12-15 11:05:54 [DEBUG   ] Got command RPT from MCS: ref #844276
2018-12-15 11:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844276  77 58467 39954870 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:06:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:06:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 11:06:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:06:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:06:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:06:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:06:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:06:04 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-12-15 11:06:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:06:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 11:06:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:07:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:07:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:07:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:07:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:07:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:07:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:07:04 [DEBUG   ] Finished updating board flags in 1.540 seconds
2018-12-15 11:07:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 11:07:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:07:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:08:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:08:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:08:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:08:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:08:04 [WARNING ] (13, 1, 'bot')
2018-12-15 11:08:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:08:04 [DEBUG   ] Finished updating board flags in 1.563 seconds
2018-12-15 11:08:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 11:08:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 11:08:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 11:09:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:09:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:09:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:09:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:09:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:09:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:09:05 [DEBUG   ] Finished updating board flags in 2.128 seconds
2018-12-15 11:09:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:09:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 11:09:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 11:10:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 11:10:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:10:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:10:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:10:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:10:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:10:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:10:05 [DEBUG   ] Finished updating board flags in 2.017 seconds
2018-12-15 11:10:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 11:10:17 [DEBUG   ] Got command RPT from MCS: ref #844298
2018-12-15 11:10:17 [DEBUG   ] summary = ERROR
2018-12-15 11:10:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844298  13 58467 40217826 A  ERRORERROR'
2018-12-15 11:10:18 [DEBUG   ] Got command RPT from MCS: ref #844299
2018-12-15 11:10:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844299  77 58467 40218029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:10:18 [DEBUG   ] Got command RPT from MCS: ref #844300
2018-12-15 11:10:18 [DEBUG   ] summary = ERROR
2018-12-15 11:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844300  13 58467 40218233 A  ERRORERROR'
2018-12-15 11:10:18 [DEBUG   ] Got command RPT from MCS: ref #844302
2018-12-15 11:10:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844302  77 58467 40218426 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:10:18 [DEBUG   ] Got command RPT from MCS: ref #844304
2018-12-15 11:10:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844304  12 58467 40218630 A  ERRORB˜™š'
2018-12-15 11:10:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 11:10:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 11:10:54 [DEBUG   ] Got command RPT from MCS: ref #844308
2018-12-15 11:10:54 [DEBUG   ] summary = ERROR
2018-12-15 11:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844308  13 58467 40254881 A  ERRORERROR'
2018-12-15 11:10:54 [DEBUG   ] Got command RPT from MCS: ref #844309
2018-12-15 11:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844309  77 58467 40254882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:11:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:11:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:11:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:11:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:11:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:11:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:11:05 [DEBUG   ] Finished updating board flags in 1.918 seconds
2018-12-15 11:11:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 11:11:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 11:11:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 11:12:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 11:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-15 11:12:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:12:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:12:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:12:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:12:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:12:05 [DEBUG   ] Finished updating board flags in 1.868 seconds
2018-12-15 11:12:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 11:12:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 11:12:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 11:13:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:13:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:13:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:13:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:13:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:13:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:13:05 [DEBUG   ] Finished updating board flags in 1.743 seconds
2018-12-15 11:13:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 11:13:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 11:13:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 11:14:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:14:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:14:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:14:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:14:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:14:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:14:05 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-15 11:14:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 11:14:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 11:14:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:15:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:15:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 11:15:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 11:15:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:15:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:15:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:15:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:15:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:15:05 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-12-15 11:15:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:15:17 [DEBUG   ] Got command RPT from MCS: ref #844333
2018-12-15 11:15:17 [DEBUG   ] summary = ERROR
2018-12-15 11:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844333  13 58467 40517909 A  ERRORERROR'
2018-12-15 11:15:18 [DEBUG   ] Got command RPT from MCS: ref #844334
2018-12-15 11:15:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844334  77 58467 40518113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:15:18 [DEBUG   ] Got command RPT from MCS: ref #844335
2018-12-15 11:15:18 [DEBUG   ] summary = ERROR
2018-12-15 11:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844335  13 58467 40518305 A  ERRORERROR'
2018-12-15 11:15:18 [DEBUG   ] Got command RPT from MCS: ref #844336
2018-12-15 11:15:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844336  77 58467 40518509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:15:18 [DEBUG   ] Got command RPT from MCS: ref #844337
2018-12-15 11:15:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844337  12 58467 40518713 A  ERRORB˜™š'
2018-12-15 11:15:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:15:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:15:54 [DEBUG   ] Got command RPT from MCS: ref #844338
2018-12-15 11:15:54 [DEBUG   ] summary = ERROR
2018-12-15 11:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844338  13 58467 40554877 A  ERRORERROR'
2018-12-15 11:15:54 [DEBUG   ] Got command RPT from MCS: ref #844339
2018-12-15 11:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844339  77 58467 40554878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:16:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:16:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:16:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:16:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:16:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:16:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:16:05 [DEBUG   ] Finished updating board flags in 1.526 seconds
2018-12-15 11:16:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:16:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 11:16:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:17:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:17:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:17:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:17:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:17:05 [WARNING ] (13, 1, 'bot')
2018-12-15 11:17:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:17:05 [DEBUG   ] Finished updating board flags in 1.519 seconds
2018-12-15 11:17:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 11:17:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 11:17:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:18:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 11:18:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:18:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:18:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:18:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:18:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:18:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:18:06 [DEBUG   ] Finished updating board flags in 2.297 seconds
2018-12-15 11:18:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:18:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:18:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:19:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:19:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:19:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:19:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:19:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:19:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:19:06 [DEBUG   ] Finished updating board flags in 2.083 seconds
2018-12-15 11:19:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:19:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:19:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:20:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 11:20:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:20:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 11:20:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:20:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:20:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:20:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:20:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:20:06 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-12-15 11:20:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:20:17 [DEBUG   ] Got command RPT from MCS: ref #844361
2018-12-15 11:20:17 [DEBUG   ] summary = ERROR
2018-12-15 11:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844361  13 58467 40817993 A  ERRORERROR'
2018-12-15 11:20:18 [DEBUG   ] Got command RPT from MCS: ref #844362
2018-12-15 11:20:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:20:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844362  77 58467 40818185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:20:18 [DEBUG   ] Got command RPT from MCS: ref #844363
2018-12-15 11:20:18 [DEBUG   ] summary = ERROR
2018-12-15 11:20:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844363  13 58467 40818389 A  ERRORERROR'
2018-12-15 11:20:18 [DEBUG   ] Got command RPT from MCS: ref #844365
2018-12-15 11:20:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:20:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844365  77 58467 40818593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:20:18 [DEBUG   ] Got command RPT from MCS: ref #844367
2018-12-15 11:20:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:20:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844367  12 58467 40818797 A  ERRORB˜™š'
2018-12-15 11:20:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:20:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:20:54 [DEBUG   ] Got command RPT from MCS: ref #844375
2018-12-15 11:20:54 [DEBUG   ] summary = ERROR
2018-12-15 11:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844375  13 58467 40854881 A  ERRORERROR'
2018-12-15 11:20:54 [DEBUG   ] Got command RPT from MCS: ref #844376
2018-12-15 11:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844376  77 58467 40854882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:21:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 11:21:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:21:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:21:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:21:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:21:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:21:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:21:06 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-12-15 11:21:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:21:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:21:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:22:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 11:22:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:22:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:22:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:22:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:22:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:22:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:22:06 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-12-15 11:22:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:22:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:22:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:23:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:23:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-15 11:23:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:23:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:23:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:23:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:23:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:23:06 [DEBUG   ] Finished updating board flags in 1.658 seconds
2018-12-15 11:23:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 11:23:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:23:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 11:24:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 11:24:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:24:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:24:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:24:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:24:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:24:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:24:06 [DEBUG   ] Finished updating board flags in 1.650 seconds
2018-12-15 11:24:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:24:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:24:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:25:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:25:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:25:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:25:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:25:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:25:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:25:06 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-12-15 11:25:08 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 11:25:18 [DEBUG   ] Got command RPT from MCS: ref #844396
2018-12-15 11:25:18 [DEBUG   ] summary = ERROR
2018-12-15 11:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844396  13 58467 41118078 A  ERRORERROR'
2018-12-15 11:25:18 [DEBUG   ] Got command RPT from MCS: ref #844397
2018-12-15 11:25:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844397  77 58467 41118269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:25:18 [DEBUG   ] Got command RPT from MCS: ref #844398
2018-12-15 11:25:18 [DEBUG   ] summary = ERROR
2018-12-15 11:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844398  13 58467 41118473 A  ERRORERROR'
2018-12-15 11:25:18 [DEBUG   ] Got command RPT from MCS: ref #844399
2018-12-15 11:25:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844399  77 58467 41118677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:25:18 [DEBUG   ] Got command RPT from MCS: ref #844400
2018-12-15 11:25:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:25:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844400  12 58467 41118869 A  ERRORB™™š'
2018-12-15 11:25:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:25:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:25:54 [DEBUG   ] Got command RPT from MCS: ref #844401
2018-12-15 11:25:54 [DEBUG   ] summary = ERROR
2018-12-15 11:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844401  13 58467 41154877 A  ERRORERROR'
2018-12-15 11:25:54 [DEBUG   ] Got command RPT from MCS: ref #844402
2018-12-15 11:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844402  77 58467 41154878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:26:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:26:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:26:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:26:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:26:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:26:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:26:06 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-12-15 11:26:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:26:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 11:26:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:27:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:27:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:27:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:27:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:27:06 [WARNING ] (13, 1, 'bot')
2018-12-15 11:27:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:27:06 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-12-15 11:27:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 11:27:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:27:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 11:28:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 11:28:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:28:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:28:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:28:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:28:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:28:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:28:07 [DEBUG   ] Finished updating board flags in 2.219 seconds
2018-12-15 11:28:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:28:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:28:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:29:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:29:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:29:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:29:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:29:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:29:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:29:07 [DEBUG   ] Finished updating board flags in 2.168 seconds
2018-12-15 11:29:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 11:29:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:29:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:30:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:30:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:30:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:30:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:30:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:30:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:30:07 [DEBUG   ] Finished updating board flags in 2.088 seconds
2018-12-15 11:30:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:30:18 [DEBUG   ] Got command RPT from MCS: ref #844428
2018-12-15 11:30:18 [DEBUG   ] summary = ERROR
2018-12-15 11:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844428  13 58467 41418149 A  ERRORERROR'
2018-12-15 11:30:18 [DEBUG   ] Got command RPT from MCS: ref #844429
2018-12-15 11:30:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844429  77 58467 41418353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:30:18 [DEBUG   ] Got command RPT from MCS: ref #844430
2018-12-15 11:30:18 [DEBUG   ] summary = ERROR
2018-12-15 11:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844430  13 58467 41418545 A  ERRORERROR'
2018-12-15 11:30:18 [DEBUG   ] Got command RPT from MCS: ref #844432
2018-12-15 11:30:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844432  77 58467 41418749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:30:18 [DEBUG   ] Got command RPT from MCS: ref #844433
2018-12-15 11:30:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:30:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844433  12 58467 41418953 A  ERRORB˜™š'
2018-12-15 11:30:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:30:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 11:30:54 [DEBUG   ] Got command RPT from MCS: ref #844438
2018-12-15 11:30:54 [DEBUG   ] summary = ERROR
2018-12-15 11:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844438  13 58467 41454881 A  ERRORERROR'
2018-12-15 11:30:54 [DEBUG   ] Got command RPT from MCS: ref #844439
2018-12-15 11:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844439  77 58467 41454882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:31:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:31:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:31:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:31:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:31:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:31:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:31:07 [DEBUG   ] Finished updating board flags in 1.959 seconds
2018-12-15 11:31:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:31:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 11:31:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:32:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 11:32:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:32:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:32:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:32:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:32:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:32:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:32:07 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-12-15 11:32:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:32:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:32:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 11:33:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:33:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:33:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:33:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:33:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:33:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:33:07 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-12-15 11:33:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 11:33:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:33:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:34:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:34:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:34:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:34:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:34:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:34:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:34:07 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-12-15 11:34:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:34:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 11:34:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:35:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:35:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 11:35:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 11:35:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:35:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:35:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:35:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:35:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:35:07 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-12-15 11:35:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:35:18 [DEBUG   ] Got command RPT from MCS: ref #844459
2018-12-15 11:35:18 [DEBUG   ] summary = ERROR
2018-12-15 11:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844459  13 58467 41718229 A  ERRORERROR'
2018-12-15 11:35:18 [DEBUG   ] Got command RPT from MCS: ref #844460
2018-12-15 11:35:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844460  77 58467 41718433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:35:18 [DEBUG   ] Got command RPT from MCS: ref #844461
2018-12-15 11:35:18 [DEBUG   ] summary = ERROR
2018-12-15 11:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844461  13 58467 41718625 A  ERRORERROR'
2018-12-15 11:35:18 [DEBUG   ] Got command RPT from MCS: ref #844462
2018-12-15 11:35:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:35:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844462  77 58467 41718829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:35:19 [DEBUG   ] Got command RPT from MCS: ref #844463
2018-12-15 11:35:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844463  12 58467 41719033 A  ERRORB˜™š'
2018-12-15 11:35:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:35:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:35:54 [DEBUG   ] Got command RPT from MCS: ref #844468
2018-12-15 11:35:54 [DEBUG   ] summary = ERROR
2018-12-15 11:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844468  13 58467 41754877 A  ERRORERROR'
2018-12-15 11:35:54 [DEBUG   ] Got command RPT from MCS: ref #844469
2018-12-15 11:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844469  77 58467 41754878 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:36:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:36:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:36:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:36:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:36:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:36:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:36:08 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-12-15 11:36:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:36:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:36:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:37:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:37:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:37:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:37:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:37:07 [WARNING ] (13, 1, 'bot')
2018-12-15 11:37:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:37:07 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-12-15 11:37:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 11:37:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-12-15 11:37:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-12-15 11:38:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:38:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:38:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:38:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:38:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:38:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:38:08 [DEBUG   ] Finished updating board flags in 2.156 seconds
2018-12-15 11:38:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 11:38:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 11:38:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 11:39:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:39:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:39:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:39:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:39:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:39:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:39:08 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-12-15 11:39:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 11:39:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 11:39:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 11:40:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:40:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:40:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:40:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:40:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:40:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:40:08 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-12-15 11:40:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 11:40:18 [DEBUG   ] Got command RPT from MCS: ref #844491
2018-12-15 11:40:18 [DEBUG   ] summary = ERROR
2018-12-15 11:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844491  13 58467 42018306 A  ERRORERROR'
2018-12-15 11:40:18 [DEBUG   ] Got command RPT from MCS: ref #844492
2018-12-15 11:40:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844492  77 58467 42018509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:40:18 [DEBUG   ] Got command RPT from MCS: ref #844493
2018-12-15 11:40:18 [DEBUG   ] summary = ERROR
2018-12-15 11:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844493  13 58467 42018713 A  ERRORERROR'
2018-12-15 11:40:18 [DEBUG   ] Got command RPT from MCS: ref #844495
2018-12-15 11:40:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:40:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844495  77 58467 42018922 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:40:19 [DEBUG   ] Got command RPT from MCS: ref #844496
2018-12-15 11:40:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:40:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844496  12 58467 42019113 A  ERRORB˜™š'
2018-12-15 11:40:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:40:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:40:54 [DEBUG   ] Got command RPT from MCS: ref #844501
2018-12-15 11:40:54 [DEBUG   ] summary = ERROR
2018-12-15 11:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844501  13 58467 42054881 A  ERRORERROR'
2018-12-15 11:40:54 [DEBUG   ] Got command RPT from MCS: ref #844502
2018-12-15 11:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844502  77 58467 42054882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:41:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 11:41:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 11:41:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:41:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:41:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:41:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:41:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:41:08 [DEBUG   ] Finished updating board flags in 1.951 seconds
2018-12-15 11:41:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 11:41:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:41:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:42:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 11:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-12-15 11:42:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:42:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:42:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:42:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:42:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:42:08 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-12-15 11:42:09 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-15 11:42:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 11:42:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 11:43:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 11:43:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:43:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:43:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:43:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:43:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:43:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:43:08 [DEBUG   ] Finished updating board flags in 1.735 seconds
2018-12-15 11:43:09 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 11:43:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 11:43:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 11:44:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:44:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:44:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:44:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:44:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:44:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:44:08 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-12-15 11:44:10 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 11:44:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 11:44:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 11:45:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:45:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:45:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:45:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:45:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:45:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:45:08 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-12-15 11:45:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-12-15 11:45:18 [DEBUG   ] Got command RPT from MCS: ref #844526
2018-12-15 11:45:18 [DEBUG   ] summary = ERROR
2018-12-15 11:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844526  13 58467 42318393 A  ERRORERROR'
2018-12-15 11:45:18 [DEBUG   ] Got command RPT from MCS: ref #844527
2018-12-15 11:45:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844527  77 58467 42318597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:45:18 [DEBUG   ] Got command RPT from MCS: ref #844528
2018-12-15 11:45:18 [DEBUG   ] summary = ERROR
2018-12-15 11:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844528  13 58467 42318789 A  ERRORERROR'
2018-12-15 11:45:18 [DEBUG   ] Got command RPT from MCS: ref #844529
2018-12-15 11:45:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844529  77 58467 42318993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:45:19 [DEBUG   ] Got command RPT from MCS: ref #844530
2018-12-15 11:45:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844530  12 58467 42319197 A  ERRORB˜™š'
2018-12-15 11:45:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 11:45:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 11:45:54 [DEBUG   ] Got command RPT from MCS: ref #844531
2018-12-15 11:45:54 [DEBUG   ] summary = ERROR
2018-12-15 11:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844531  13 58467 42354885 A  ERRORERROR'
2018-12-15 11:45:54 [DEBUG   ] Got command RPT from MCS: ref #844532
2018-12-15 11:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844532  77 58467 42354886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:46:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:46:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:46:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:46:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:46:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:46:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:46:08 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-12-15 11:46:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 11:46:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 11:46:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 11:47:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:47:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:47:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:47:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:47:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:47:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:47:08 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-12-15 11:47:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-12-15 11:47:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:47:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:48:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 11:48:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:48:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 11:48:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:48:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:48:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:48:08 [WARNING ] (13, 1, 'bot')
2018-12-15 11:48:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:48:08 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-12-15 11:48:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 11:48:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 11:48:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:49:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:49:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 11:49:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:49:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:49:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:49:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:49:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:49:09 [DEBUG   ] Finished updating board flags in 2.138 seconds
2018-12-15 11:49:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 11:49:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 11:49:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:50:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 11:50:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 11:50:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:50:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:50:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:50:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:50:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:50:09 [DEBUG   ] Finished updating board flags in 1.939 seconds
2018-12-15 11:50:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:50:18 [DEBUG   ] Got command RPT from MCS: ref #844554
2018-12-15 11:50:18 [DEBUG   ] summary = ERROR
2018-12-15 11:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844554  13 58467 42618465 A  ERRORERROR'
2018-12-15 11:50:18 [DEBUG   ] Got command RPT from MCS: ref #844555
2018-12-15 11:50:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844555  77 58467 42618669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:50:18 [DEBUG   ] Got command RPT from MCS: ref #844556
2018-12-15 11:50:18 [DEBUG   ] summary = ERROR
2018-12-15 11:50:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844556  13 58467 42618873 A  ERRORERROR'
2018-12-15 11:50:19 [DEBUG   ] Got command RPT from MCS: ref #844558
2018-12-15 11:50:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844558  77 58467 42619077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:50:19 [DEBUG   ] Got command RPT from MCS: ref #844559
2018-12-15 11:50:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844559  12 58467 42619269 A  ERRORB˜™š'
2018-12-15 11:50:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:50:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 11:50:54 [DEBUG   ] Got command RPT from MCS: ref #844568
2018-12-15 11:50:54 [DEBUG   ] summary = ERROR
2018-12-15 11:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844568  13 58467 42654881 A  ERRORERROR'
2018-12-15 11:50:54 [DEBUG   ] Got command RPT from MCS: ref #844569
2018-12-15 11:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844569  77 58467 42654882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:51:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:51:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 11:51:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:51:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:51:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:51:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:51:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:51:09 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-12-15 11:51:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 11:51:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:51:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:52:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:52:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:52:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:52:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:52:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:52:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:52:09 [DEBUG   ] Finished updating board flags in 1.785 seconds
2018-12-15 11:52:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 11:52:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:52:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:53:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:53:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:53:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:53:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:53:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:53:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:53:09 [DEBUG   ] Finished updating board flags in 1.634 seconds
2018-12-15 11:53:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 11:53:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 11:53:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:54:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:54:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:54:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:54:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:54:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:54:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:54:09 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-12-15 11:54:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:54:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 11:54:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 11:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:55:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:55:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:55:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:55:09 [WARNING ] (13, 1, 'bot')
2018-12-15 11:55:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:55:09 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-12-15 11:55:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 11:55:18 [DEBUG   ] Got command RPT from MCS: ref #844589
2018-12-15 11:55:18 [DEBUG   ] summary = ERROR
2018-12-15 11:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844589  13 58467 42918545 A  ERRORERROR'
2018-12-15 11:55:18 [DEBUG   ] Got command RPT from MCS: ref #844590
2018-12-15 11:55:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844590  77 58467 42918749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:55:18 [DEBUG   ] Got command RPT from MCS: ref #844591
2018-12-15 11:55:18 [DEBUG   ] summary = ERROR
2018-12-15 11:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844591  13 58467 42918953 A  ERRORERROR'
2018-12-15 11:55:19 [DEBUG   ] Got command RPT from MCS: ref #844592
2018-12-15 11:55:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844592  77 58467 42919159 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:55:19 [DEBUG   ] Got command RPT from MCS: ref #844593
2018-12-15 11:55:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 11:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844593  12 58467 42919349 A  ERRORB™™š'
2018-12-15 11:55:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 11:55:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 11:55:54 [DEBUG   ] Got command RPT from MCS: ref #844594
2018-12-15 11:55:54 [DEBUG   ] summary = ERROR
2018-12-15 11:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844594  13 58467 42954889 A  ERRORERROR'
2018-12-15 11:55:54 [DEBUG   ] Got command RPT from MCS: ref #844595
2018-12-15 11:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 11:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844595  77 58467 42954890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 11:56:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 11:56:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:56:10 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2018-12-15 11:56:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:56:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:56:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:56:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:56:10 [DEBUG   ] Finished updating board flags in 2.273 seconds
2018-12-15 11:56:30 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-12-15 11:56:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 11:57:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:57:10 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2018-12-15 11:57:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:57:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:57:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:57:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:57:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:57:10 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-12-15 11:57:30 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-12-15 11:57:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 11:58:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:58:10 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2018-12-15 11:58:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:58:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:58:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:58:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:58:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:58:10 [DEBUG   ] Finished updating board flags in 2.139 seconds
2018-12-15 11:58:31 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2018-12-15 11:58:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 11:59:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 11:59:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:59:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:59:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:59:10 [WARNING ] (13, 1, 'bot')
2018-12-15 11:59:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 11:59:10 [DEBUG   ] Finished updating board flags in 2.046 seconds
2018-12-15 11:59:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 11:59:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 11:59:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:00:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:00:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 12:00:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:00:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:00:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:00:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:00:11 [DEBUG   ] Finished updating board flags in 2.859 seconds
2018-12-15 12:00:18 [DEBUG   ] Got command RPT from MCS: ref #844621
2018-12-15 12:00:18 [DEBUG   ] summary = ERROR
2018-12-15 12:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844621  13 58467 43218625 A  ERRORERROR'
2018-12-15 12:00:18 [DEBUG   ] Got command RPT from MCS: ref #844622
2018-12-15 12:00:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:00:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844622  77 58467 43218829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:00:19 [DEBUG   ] Got command RPT from MCS: ref #844623
2018-12-15 12:00:19 [DEBUG   ] summary = ERROR
2018-12-15 12:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844623  13 58467 43219037 A  ERRORERROR'
2018-12-15 12:00:19 [DEBUG   ] Got command RPT from MCS: ref #844625
2018-12-15 12:00:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844625  77 58467 43219229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:00:19 [DEBUG   ] Got command RPT from MCS: ref #844626
2018-12-15 12:00:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844626  12 58467 43219433 A  ERRORB˜™š'
2018-12-15 12:00:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 12:00:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:00:54 [DEBUG   ] Got command RPT from MCS: ref #844631
2018-12-15 12:00:54 [DEBUG   ] summary = ERROR
2018-12-15 12:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844631  13 58467 43254881 A  ERRORERROR'
2018-12-15 12:00:54 [DEBUG   ] Got command RPT from MCS: ref #844632
2018-12-15 12:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844632  77 58467 43254882 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:01:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:01:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:01:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:01:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:01:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:01:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:01:10 [DEBUG   ] Finished updating board flags in 1.920 seconds
2018-12-15 12:01:11 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-15 12:01:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 12:01:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 12:02:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:02:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:02:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:02:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:02:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:02:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:02:10 [DEBUG   ] Finished updating board flags in 1.739 seconds
2018-12-15 12:02:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 12:02:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 12:02:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 12:03:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:03:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:03:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:03:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:03:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:03:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:03:10 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-12-15 12:03:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 12:03:32 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 12:03:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 12:04:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:04:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:04:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:04:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:04:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:04:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:04:10 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-12-15 12:04:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:04:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:04:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 12:05:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:05:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:05:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:05:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:05:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:05:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:05:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:05:10 [DEBUG   ] Finished updating board flags in 1.461 seconds
2018-12-15 12:05:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 12:05:18 [DEBUG   ] Got command RPT from MCS: ref #844652
2018-12-15 12:05:18 [DEBUG   ] summary = ERROR
2018-12-15 12:05:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844652  13 58467 43518717 A  ERRORERROR'
2018-12-15 12:05:18 [DEBUG   ] Got command RPT from MCS: ref #844653
2018-12-15 12:05:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:05:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844653  77 58467 43518909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:05:19 [DEBUG   ] Got command RPT from MCS: ref #844654
2018-12-15 12:05:19 [DEBUG   ] summary = ERROR
2018-12-15 12:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844654  13 58467 43519113 A  ERRORERROR'
2018-12-15 12:05:19 [DEBUG   ] Got command RPT from MCS: ref #844655
2018-12-15 12:05:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844655  77 58467 43519317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:05:19 [DEBUG   ] Got command RPT from MCS: ref #844656
2018-12-15 12:05:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844656  12 58467 43519509 A  ERRORB™™š'
2018-12-15 12:05:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:05:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 12:05:54 [DEBUG   ] Got command RPT from MCS: ref #844661
2018-12-15 12:05:54 [DEBUG   ] summary = ERROR
2018-12-15 12:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844661  13 58467 43554885 A  ERRORERROR'
2018-12-15 12:05:54 [DEBUG   ] Got command RPT from MCS: ref #844662
2018-12-15 12:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844662  77 58467 43554886 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:06:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:06:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:06:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:06:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:06:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:06:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:06:10 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-12-15 12:06:12 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-15 12:06:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:06:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:07:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:07:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:07:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:07:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:07:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:07:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:07:10 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-15 12:07:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:07:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 12:07:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 12:08:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:08:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:08:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:08:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:08:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:08:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:08:10 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-12-15 12:08:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 12:08:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:08:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 12:09:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-12-15 12:09:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:09:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:09:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:09:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:09:10 [WARNING ] (13, 1, 'bot')
2018-12-15 12:09:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:09:10 [DEBUG   ] Finished updating board flags in 1.470 seconds
2018-12-15 12:09:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:09:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:09:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:10:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:10:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 12:10:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:10:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:10:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:10:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:10:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:10:12 [DEBUG   ] Finished updating board flags in 2.934 seconds
2018-12-15 12:10:18 [DEBUG   ] Got command RPT from MCS: ref #844684
2018-12-15 12:10:18 [DEBUG   ] summary = ERROR
2018-12-15 12:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844684  13 58467 43818789 A  ERRORERROR'
2018-12-15 12:10:18 [DEBUG   ] Got command RPT from MCS: ref #844685
2018-12-15 12:10:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844685  77 58467 43818993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:10:19 [DEBUG   ] Got command RPT from MCS: ref #844686
2018-12-15 12:10:19 [DEBUG   ] summary = ERROR
2018-12-15 12:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844686  13 58467 43819197 A  ERRORERROR'
2018-12-15 12:10:19 [DEBUG   ] Got command RPT from MCS: ref #844688
2018-12-15 12:10:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844688  77 58467 43819389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:10:19 [DEBUG   ] Got command RPT from MCS: ref #844690
2018-12-15 12:10:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844690  12 58467 43819593 A  ERRORB˜™š'
2018-12-15 12:10:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 12:10:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 12:10:54 [DEBUG   ] Got command RPT from MCS: ref #844694
2018-12-15 12:10:54 [DEBUG   ] summary = ERROR
2018-12-15 12:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844694  13 58467 43854893 A  ERRORERROR'
2018-12-15 12:10:54 [DEBUG   ] Got command RPT from MCS: ref #844695
2018-12-15 12:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844695  77 58467 43854894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:11:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:11:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:11:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:11:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:11:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:11:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:11:11 [DEBUG   ] Finished updating board flags in 2.033 seconds
2018-12-15 12:11:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 12:11:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 12:11:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 12:12:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:12:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:12:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:12:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:12:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:12:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:12:11 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-12-15 12:12:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 12:12:33 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 12:12:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-12-15 12:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 12:13:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:13:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:13:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:13:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:13:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:13:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:13:11 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-12-15 12:13:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:13:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:13:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:14:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 12:14:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:14:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:14:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:14:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:14:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:14:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:14:11 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-12-15 12:14:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:14:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:14:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:15:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 12:15:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:15:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:15:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 12:15:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:15:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:15:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:15:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:15:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:15:11 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-12-15 12:15:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 12:15:18 [DEBUG   ] Got command RPT from MCS: ref #844719
2018-12-15 12:15:18 [DEBUG   ] summary = ERROR
2018-12-15 12:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844719  13 58467 44118865 A  ERRORERROR'
2018-12-15 12:15:19 [DEBUG   ] Got command RPT from MCS: ref #844720
2018-12-15 12:15:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844720  77 58467 44119069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:15:19 [DEBUG   ] Got command RPT from MCS: ref #844721
2018-12-15 12:15:19 [DEBUG   ] summary = ERROR
2018-12-15 12:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844721  13 58467 44119273 A  ERRORERROR'
2018-12-15 12:15:19 [DEBUG   ] Got command RPT from MCS: ref #844722
2018-12-15 12:15:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844722  77 58467 44119477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:15:19 [DEBUG   ] Got command RPT from MCS: ref #844723
2018-12-15 12:15:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844723  12 58467 44119669 A  ERRORB™™š'
2018-12-15 12:15:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:15:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:15:54 [DEBUG   ] Got command RPT from MCS: ref #844724
2018-12-15 12:15:54 [DEBUG   ] summary = ERROR
2018-12-15 12:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844724  13 58467 44154889 A  ERRORERROR'
2018-12-15 12:15:54 [DEBUG   ] Got command RPT from MCS: ref #844725
2018-12-15 12:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844725  77 58467 44154890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:16:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:16:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:16:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:16:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:16:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:16:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:16:11 [DEBUG   ] Finished updating board flags in 1.650 seconds
2018-12-15 12:16:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 12:16:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 12:16:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:17:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:17:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:17:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:17:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:17:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:17:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:17:11 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-12-15 12:17:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 12:17:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:17:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:18:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 12:18:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:18:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:18:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:18:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:18:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:18:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:18:11 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-12-15 12:18:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:18:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 12:18:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:19:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:19:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 12:19:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:19:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:19:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:19:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:19:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:19:11 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-12-15 12:19:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 12:19:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 12:19:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:20:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 12:20:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:20:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:20:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:20:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:20:11 [WARNING ] (13, 1, 'bot')
2018-12-15 12:20:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:20:11 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-12-15 12:20:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:20:18 [DEBUG   ] Got command RPT from MCS: ref #844747
2018-12-15 12:20:18 [DEBUG   ] summary = ERROR
2018-12-15 12:20:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844747  13 58467 44418953 A  ERRORERROR'
2018-12-15 12:20:19 [DEBUG   ] Got command RPT from MCS: ref #844748
2018-12-15 12:20:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844748  77 58467 44419166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:20:19 [DEBUG   ] Got command RPT from MCS: ref #844749
2018-12-15 12:20:19 [DEBUG   ] summary = ERROR
2018-12-15 12:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844749  13 58467 44419357 A  ERRORERROR'
2018-12-15 12:20:19 [DEBUG   ] Got command RPT from MCS: ref #844750
2018-12-15 12:20:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844750  77 58467 44419549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:20:19 [DEBUG   ] Got command RPT from MCS: ref #844752
2018-12-15 12:20:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844752  12 58467 44419753 A  ERRORB™™š'
2018-12-15 12:20:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 12:20:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:20:54 [DEBUG   ] Got command RPT from MCS: ref #844761
2018-12-15 12:20:54 [DEBUG   ] summary = ERROR
2018-12-15 12:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844761  13 58467 44454889 A  ERRORERROR'
2018-12-15 12:20:54 [DEBUG   ] Got command RPT from MCS: ref #844762
2018-12-15 12:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844762  77 58467 44454890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:21:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 12:21:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:21:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:21:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:21:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:21:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:21:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:21:12 [DEBUG   ] Finished updating board flags in 2.227 seconds
2018-12-15 12:21:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:21:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:21:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 12:22:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:22:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 12:22:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:22:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:22:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:22:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:22:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:22:13 [DEBUG   ] Finished updating board flags in 2.921 seconds
2018-12-15 12:22:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 12:22:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 12:23:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:23:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-12-15 12:23:12 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:23:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:23:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:23:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:23:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:23:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:23:12 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-12-15 12:23:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 12:23:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 12:23:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 12:24:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:24:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:24:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:24:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:24:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:24:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:24:12 [DEBUG   ] Finished updating board flags in 1.837 seconds
2018-12-15 12:24:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 12:24:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 12:24:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 12:25:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:25:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:25:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:25:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:25:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:25:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:25:12 [DEBUG   ] Finished updating board flags in 1.765 seconds
2018-12-15 12:25:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 12:25:19 [DEBUG   ] Got command RPT from MCS: ref #844782
2018-12-15 12:25:19 [DEBUG   ] summary = ERROR
2018-12-15 12:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844782  13 58467 44719033 A  ERRORERROR'
2018-12-15 12:25:19 [DEBUG   ] Got command RPT from MCS: ref #844783
2018-12-15 12:25:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844783  77 58467 44719237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:25:19 [DEBUG   ] Got command RPT from MCS: ref #844784
2018-12-15 12:25:19 [DEBUG   ] summary = ERROR
2018-12-15 12:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844784  13 58467 44719429 A  ERRORERROR'
2018-12-15 12:25:19 [DEBUG   ] Got command RPT from MCS: ref #844785
2018-12-15 12:25:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844785  77 58467 44719633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:25:19 [DEBUG   ] Got command RPT from MCS: ref #844786
2018-12-15 12:25:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:25:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844786  12 58467 44719837 A  ERRORB™™š'
2018-12-15 12:25:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:25:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:25:54 [DEBUG   ] Got command RPT from MCS: ref #844787
2018-12-15 12:25:54 [DEBUG   ] summary = ERROR
2018-12-15 12:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844787  13 58467 44754889 A  ERRORERROR'
2018-12-15 12:25:54 [DEBUG   ] Got command RPT from MCS: ref #844788
2018-12-15 12:25:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844788  77 58467 44754890 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:26:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:26:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-12-15 12:26:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:26:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:26:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:26:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:26:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:26:12 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-12-15 12:26:14 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-12-15 12:26:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:26:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:27:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:27:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:27:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:27:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:27:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:27:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:27:12 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-12-15 12:27:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 12:27:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 12:27:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 12:28:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:28:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:28:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:28:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:28:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:28:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:28:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:28:12 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-12-15 12:28:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:28:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-12-15 12:28:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 12:29:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:29:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:29:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:29:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:29:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:29:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:29:12 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-12-15 12:29:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 12:29:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 12:29:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:30:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 12:30:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:30:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 12:30:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:30:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:30:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:30:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:30:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:30:12 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-12-15 12:30:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 12:30:19 [DEBUG   ] Got command RPT from MCS: ref #844814
2018-12-15 12:30:19 [DEBUG   ] summary = ERROR
2018-12-15 12:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844814  13 58467 45019109 A  ERRORERROR'
2018-12-15 12:30:19 [DEBUG   ] Got command RPT from MCS: ref #844815
2018-12-15 12:30:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844815  77 58467 45019314 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:30:19 [DEBUG   ] Got command RPT from MCS: ref #844816
2018-12-15 12:30:19 [DEBUG   ] summary = ERROR
2018-12-15 12:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844816  13 58467 45019517 A  ERRORERROR'
2018-12-15 12:30:19 [DEBUG   ] Got command RPT from MCS: ref #844818
2018-12-15 12:30:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844818  77 58467 45019721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:30:19 [DEBUG   ] Got command RPT from MCS: ref #844819
2018-12-15 12:30:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844819  12 58467 45019914 A  ERRORB˜™š'
2018-12-15 12:30:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 12:30:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:30:54 [DEBUG   ] Got command RPT from MCS: ref #844824
2018-12-15 12:30:54 [DEBUG   ] summary = ERROR
2018-12-15 12:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844824  13 58467 45054894 A  ERRORERROR'
2018-12-15 12:30:54 [DEBUG   ] Got command RPT from MCS: ref #844825
2018-12-15 12:30:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844825  77 58467 45054894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:31:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:31:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:31:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:31:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:31:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:31:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:31:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:31:12 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-12-15 12:31:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:31:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 12:31:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 12:32:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:32:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:32:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:32:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:32:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:32:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:32:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:32:12 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-12-15 12:32:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 12:32:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 12:32:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 12:33:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:33:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:33:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:33:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:33:12 [WARNING ] (13, 1, 'bot')
2018-12-15 12:33:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:33:12 [DEBUG   ] Finished updating board flags in 1.500 seconds
2018-12-15 12:33:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 12:33:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 12:33:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 12:34:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:34:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 12:34:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:34:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:34:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:34:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:34:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:34:13 [DEBUG   ] Finished updating board flags in 2.269 seconds
2018-12-15 12:34:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 12:34:34 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-15 12:34:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-12-15 12:35:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:35:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:35:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:35:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:35:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:35:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:35:13 [DEBUG   ] Finished updating board flags in 2.092 seconds
2018-12-15 12:35:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:35:19 [DEBUG   ] Got command RPT from MCS: ref #844845
2018-12-15 12:35:19 [DEBUG   ] summary = ERROR
2018-12-15 12:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844845  13 58467 45319197 A  ERRORERROR'
2018-12-15 12:35:19 [DEBUG   ] Got command RPT from MCS: ref #844846
2018-12-15 12:35:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844846  77 58467 45319389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:35:19 [DEBUG   ] Got command RPT from MCS: ref #844847
2018-12-15 12:35:19 [DEBUG   ] summary = ERROR
2018-12-15 12:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844847  13 58467 45319593 A  ERRORERROR'
2018-12-15 12:35:19 [DEBUG   ] Got command RPT from MCS: ref #844848
2018-12-15 12:35:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:35:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844848  77 58467 45319797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:35:20 [DEBUG   ] Got command RPT from MCS: ref #844849
2018-12-15 12:35:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:35:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844849  12 58467 45320001 A  ERRORB™™š'
2018-12-15 12:35:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 12:35:54 [DEBUG   ] Got command RPT from MCS: ref #844854
2018-12-15 12:35:54 [DEBUG   ] summary = ERROR
2018-12-15 12:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844854  13 58467 45354897 A  ERRORERROR'
2018-12-15 12:35:54 [DEBUG   ] Got command RPT from MCS: ref #844855
2018-12-15 12:35:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:35:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844855  77 58467 45354898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:35:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:36:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:36:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:36:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:36:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:36:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:36:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:36:13 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-12-15 12:36:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 12:36:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:36:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 12:37:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:37:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:37:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:37:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:37:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:37:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:37:13 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-12-15 12:37:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 12:37:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 12:37:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:38:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:38:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:38:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:38:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:38:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:38:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:38:13 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-12-15 12:38:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:38:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 12:38:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 12:39:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 12:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:39:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:39:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:39:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:39:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:39:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:39:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:39:13 [DEBUG   ] Finished updating board flags in 1.878 seconds
2018-12-15 12:39:15 [DEBUG   ] Finished updating ant stats in 1.142 seconds
2018-12-15 12:39:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:39:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:40:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:40:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:40:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:40:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:40:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:40:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:40:13 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-12-15 12:40:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-12-15 12:40:19 [DEBUG   ] Got command RPT from MCS: ref #844877
2018-12-15 12:40:19 [DEBUG   ] summary = ERROR
2018-12-15 12:40:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844877  13 58467 45619269 A  ERRORERROR'
2018-12-15 12:40:19 [DEBUG   ] Got command RPT from MCS: ref #844878
2018-12-15 12:40:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:40:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844878  77 58467 45619473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:40:19 [DEBUG   ] Got command RPT from MCS: ref #844879
2018-12-15 12:40:19 [DEBUG   ] summary = ERROR
2018-12-15 12:40:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844879  13 58467 45619677 A  ERRORERROR'
2018-12-15 12:40:19 [DEBUG   ] Got command RPT from MCS: ref #844881
2018-12-15 12:40:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:40:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844881  77 58467 45619895 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:40:20 [DEBUG   ] Got command RPT from MCS: ref #844882
2018-12-15 12:40:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:40:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844882  12 58467 45620073 A  ERRORB˜™š'
2018-12-15 12:40:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 12:40:54 [DEBUG   ] Got command RPT from MCS: ref #844887
2018-12-15 12:40:54 [DEBUG   ] summary = ERROR
2018-12-15 12:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844887  13 58467 45654897 A  ERRORERROR'
2018-12-15 12:40:54 [DEBUG   ] Got command RPT from MCS: ref #844888
2018-12-15 12:40:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:40:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844888  77 58467 45654898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:40:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-12-15 12:41:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:41:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:41:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:41:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:41:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:41:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:41:13 [DEBUG   ] Finished updating board flags in 1.688 seconds
2018-12-15 12:41:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:41:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:41:55 [DEBUG   ] Finished updating ant stats in 0.750 seconds
2018-12-15 12:42:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:42:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 12:42:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:42:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:42:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:42:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:42:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:42:13 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-12-15 12:42:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-12-15 12:42:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 12:42:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-12-15 12:43:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:43:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:43:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:43:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:43:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:43:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:43:13 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-12-15 12:43:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 12:43:36 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-12-15 12:43:56 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-12-15 12:44:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:44:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:44:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:44:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:44:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:44:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:44:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:44:13 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-12-15 12:44:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:44:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 12:44:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:45:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:45:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:45:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:45:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:45:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:45:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:45:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:45:13 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-12-15 12:45:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 12:45:19 [DEBUG   ] Got command RPT from MCS: ref #844912
2018-12-15 12:45:19 [DEBUG   ] summary = ERROR
2018-12-15 12:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844912  13 58467 45919349 A  ERRORERROR'
2018-12-15 12:45:19 [DEBUG   ] Got command RPT from MCS: ref #844913
2018-12-15 12:45:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844913  77 58467 45919553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:45:19 [DEBUG   ] Got command RPT from MCS: ref #844914
2018-12-15 12:45:19 [DEBUG   ] summary = ERROR
2018-12-15 12:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844914  13 58467 45919757 A  ERRORERROR'
2018-12-15 12:45:19 [DEBUG   ] Got command RPT from MCS: ref #844915
2018-12-15 12:45:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:45:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844915  77 58467 45919949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:45:20 [DEBUG   ] Got command RPT from MCS: ref #844916
2018-12-15 12:45:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:45:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844916  12 58467 45920153 A  ERRORB™™š'
2018-12-15 12:45:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:45:54 [DEBUG   ] Got command RPT from MCS: ref #844917
2018-12-15 12:45:54 [DEBUG   ] summary = ERROR
2018-12-15 12:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844917  13 58467 45954894 A  ERRORERROR'
2018-12-15 12:45:54 [DEBUG   ] Got command RPT from MCS: ref #844918
2018-12-15 12:45:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:45:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844918  77 58467 45954894 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:45:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:46:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 12:46:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:46:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:46:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:46:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:46:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:46:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:46:13 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-12-15 12:46:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:46:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:46:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:47:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 12:47:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:47:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:47:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:47:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:47:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:47:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:47:13 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-12-15 12:47:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:47:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 12:47:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 12:48:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:48:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 12:48:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:48:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:48:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:48:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:48:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:48:13 [DEBUG   ] Finished updating board flags in 1.533 seconds
2018-12-15 12:48:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-12-15 12:48:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-12-15 12:48:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 12:49:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:49:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:49:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:49:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:49:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:49:13 [WARNING ] (13, 1, 'bot')
2018-12-15 12:49:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:49:13 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-12-15 12:49:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-12-15 12:49:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:49:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:50:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 12:50:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:50:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:50:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:50:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:50:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:50:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:50:14 [DEBUG   ] Finished updating board flags in 2.197 seconds
2018-12-15 12:50:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:50:19 [DEBUG   ] Got command RPT from MCS: ref #844940
2018-12-15 12:50:19 [DEBUG   ] summary = ERROR
2018-12-15 12:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844940  13 58467 46219437 A  ERRORERROR'
2018-12-15 12:50:19 [DEBUG   ] Got command RPT from MCS: ref #844941
2018-12-15 12:50:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844941  77 58467 46219629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:50:19 [DEBUG   ] Got command RPT from MCS: ref #844942
2018-12-15 12:50:19 [DEBUG   ] summary = ERROR
2018-12-15 12:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844942  13 58467 46219833 A  ERRORERROR'
2018-12-15 12:50:20 [DEBUG   ] Got command RPT from MCS: ref #844944
2018-12-15 12:50:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844944  77 58467 46220037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:50:20 [DEBUG   ] Got command RPT from MCS: ref #844945
2018-12-15 12:50:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844945  12 58467 46220241 A  ERRORB˜™š'
2018-12-15 12:50:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:50:54 [DEBUG   ] Got command RPT from MCS: ref #844954
2018-12-15 12:50:54 [DEBUG   ] summary = ERROR
2018-12-15 12:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844954  13 58467 46254901 A  ERRORERROR'
2018-12-15 12:50:54 [DEBUG   ] Got command RPT from MCS: ref #844955
2018-12-15 12:50:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844955  77 58467 46254902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:50:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:51:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:51:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:51:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:51:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:51:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:51:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:51:14 [DEBUG   ] Finished updating board flags in 1.876 seconds
2018-12-15 12:51:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:51:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:51:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:52:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:52:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:52:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:52:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:52:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:52:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:52:14 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-12-15 12:52:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:52:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:52:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:53:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:53:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:53:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:53:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:53:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:53:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:53:14 [DEBUG   ] Finished updating board flags in 1.794 seconds
2018-12-15 12:53:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:53:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:53:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 12:54:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:54:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 12:54:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:54:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:54:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:54:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:54:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:54:14 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-12-15 12:54:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:54:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 12:54:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:55:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:55:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:55:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 12:55:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:55:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:55:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:55:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:55:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:55:14 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-12-15 12:55:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 12:55:19 [DEBUG   ] Got command RPT from MCS: ref #844975
2018-12-15 12:55:19 [DEBUG   ] summary = ERROR
2018-12-15 12:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844975  13 58467 46519509 A  ERRORERROR'
2018-12-15 12:55:19 [DEBUG   ] Got command RPT from MCS: ref #844976
2018-12-15 12:55:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844976  77 58467 46519713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:55:19 [DEBUG   ] Got command RPT from MCS: ref #844977
2018-12-15 12:55:19 [DEBUG   ] summary = ERROR
2018-12-15 12:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844977  13 58467 46519922 A  ERRORERROR'
2018-12-15 12:55:20 [DEBUG   ] Got command RPT from MCS: ref #844978
2018-12-15 12:55:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:55:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844978  77 58467 46520113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:55:20 [DEBUG   ] Got command RPT from MCS: ref #844979
2018-12-15 12:55:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 12:55:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844979  12 58467 46520317 A  ERRORB™™š'
2018-12-15 12:55:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:55:54 [DEBUG   ] Got command RPT from MCS: ref #844980
2018-12-15 12:55:54 [DEBUG   ] summary = ERROR
2018-12-15 12:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844980  13 58467 46554901 A  ERRORERROR'
2018-12-15 12:55:54 [DEBUG   ] Got command RPT from MCS: ref #844981
2018-12-15 12:55:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 12:55:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   844981  77 58467 46554902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 12:55:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:56:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:56:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:56:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:56:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:56:14 [WARNING ] (13, 1, 'bot')
2018-12-15 12:56:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:56:14 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-12-15 12:56:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:56:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:56:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:57:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:57:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 12:57:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:57:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:57:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:57:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:57:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:57:15 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-12-15 12:57:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:57:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:57:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 12:58:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:58:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:58:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:58:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:58:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:58:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:58:15 [DEBUG   ] Finished updating board flags in 2.168 seconds
2018-12-15 12:58:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 12:58:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:58:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:59:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 12:59:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:59:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:59:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:59:15 [WARNING ] (13, 1, 'bot')
2018-12-15 12:59:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 12:59:15 [DEBUG   ] Finished updating board flags in 2.038 seconds
2018-12-15 12:59:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 12:59:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 12:59:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 13:00:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:00:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:00:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:00:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:00:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:00:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:00:15 [DEBUG   ] Finished updating board flags in 1.848 seconds
2018-12-15 13:00:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 13:00:19 [DEBUG   ] Got command RPT from MCS: ref #845007
2018-12-15 13:00:19 [DEBUG   ] summary = ERROR
2018-12-15 13:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845007  13 58467 46819593 A  ERRORERROR'
2018-12-15 13:00:19 [DEBUG   ] Got command RPT from MCS: ref #845008
2018-12-15 13:00:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:00:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845008  77 58467 46819797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:00:20 [DEBUG   ] Got command RPT from MCS: ref #845009
2018-12-15 13:00:20 [DEBUG   ] summary = ERROR
2018-12-15 13:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845009  13 58467 46820001 A  ERRORERROR'
2018-12-15 13:00:20 [DEBUG   ] Got command RPT from MCS: ref #845011
2018-12-15 13:00:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845011  77 58467 46820193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:00:20 [DEBUG   ] Got command RPT from MCS: ref #845012
2018-12-15 13:00:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 13:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845012  12 58467 46820397 A  ERRORB˜™š'
2018-12-15 13:00:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 13:00:54 [DEBUG   ] Got command RPT from MCS: ref #845017
2018-12-15 13:00:54 [DEBUG   ] summary = ERROR
2018-12-15 13:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845017  13 58467 46854897 A  ERRORERROR'
2018-12-15 13:00:54 [DEBUG   ] Got command RPT from MCS: ref #845018
2018-12-15 13:00:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:00:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845018  77 58467 46854898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:00:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 13:01:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:01:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:01:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:01:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:01:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:01:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:01:15 [DEBUG   ] Finished updating board flags in 1.837 seconds
2018-12-15 13:01:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-12-15 13:01:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 13:01:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 13:02:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 13:02:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-12-15 13:02:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:02:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:02:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:02:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:02:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:02:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:02:15 [DEBUG   ] Finished updating board flags in 1.742 seconds
2018-12-15 13:02:16 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-12-15 13:02:37 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-12-15 13:02:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 13:03:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:03:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-12-15 13:03:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:03:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:03:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:03:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:03:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:03:15 [DEBUG   ] Finished updating board flags in 1.631 seconds
2018-12-15 13:03:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 13:03:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 13:03:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 13:04:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:04:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:04:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:04:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:04:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:04:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:04:15 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-12-15 13:04:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 13:04:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 13:04:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 13:05:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:05:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:05:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:05:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:05:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:05:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:05:15 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-12-15 13:05:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 13:05:19 [DEBUG   ] Got command RPT from MCS: ref #845038
2018-12-15 13:05:19 [DEBUG   ] summary = ERROR
2018-12-15 13:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845038  13 58467 47119673 A  ERRORERROR'
2018-12-15 13:05:19 [DEBUG   ] Got command RPT from MCS: ref #845039
2018-12-15 13:05:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845039  77 58467 47119877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:05:20 [DEBUG   ] Got command RPT from MCS: ref #845040
2018-12-15 13:05:20 [DEBUG   ] summary = ERROR
2018-12-15 13:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845040  13 58467 47120081 A  ERRORERROR'
2018-12-15 13:05:20 [DEBUG   ] Got command RPT from MCS: ref #845041
2018-12-15 13:05:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845041  77 58467 47120285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:05:20 [DEBUG   ] Got command RPT from MCS: ref #845042
2018-12-15 13:05:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 13:05:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845042  12 58467 47120477 A  ERRORB™™š'
2018-12-15 13:05:37 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-12-15 13:05:54 [DEBUG   ] Got command RPT from MCS: ref #845047
2018-12-15 13:05:54 [DEBUG   ] summary = ERROR
2018-12-15 13:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845047  13 58467 47154905 A  ERRORERROR'
2018-12-15 13:05:54 [DEBUG   ] Got command RPT from MCS: ref #845048
2018-12-15 13:05:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:05:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845048  77 58467 47154906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:05:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-12-15 13:06:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:06:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:06:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:06:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:06:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:06:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:06:15 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-12-15 13:06:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-12-15 13:06:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 13:06:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 13:07:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:07:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:07:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:07:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:07:15 [WARNING ] (13, 1, 'bot')
2018-12-15 13:07:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:07:15 [DEBUG   ] Finished updating board flags in 1.355 seconds
2018-12-15 13:07:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 13:07:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 13:07:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 13:08:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 13:08:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:08:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:08:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:08:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:08:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:08:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:08:16 [DEBUG   ] Finished updating board flags in 2.156 seconds
2018-12-15 13:08:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-12-15 13:08:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 13:08:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 13:09:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 13:09:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:09:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:09:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:09:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:09:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:09:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:09:16 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-12-15 13:09:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-12-15 13:09:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-12-15 13:09:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-12-15 13:10:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 13:10:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:10:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:10:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:10:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:10:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:10:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:10:16 [DEBUG   ] Finished updating board flags in 1.735 seconds
2018-12-15 13:10:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-12-15 13:10:19 [DEBUG   ] Got command RPT from MCS: ref #845070
2018-12-15 13:10:19 [DEBUG   ] summary = ERROR
2018-12-15 13:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845070  13 58467 47419761 A  ERRORERROR'
2018-12-15 13:10:19 [DEBUG   ] Got command RPT from MCS: ref #845071
2018-12-15 13:10:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845071  77 58467 47419953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:10:20 [DEBUG   ] Got command RPT from MCS: ref #845072
2018-12-15 13:10:20 [DEBUG   ] summary = ERROR
2018-12-15 13:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845072  13 58467 47420157 A  ERRORERROR'
2018-12-15 13:10:20 [DEBUG   ] Got command RPT from MCS: ref #845074
2018-12-15 13:10:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845074  77 58467 47420361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:10:20 [DEBUG   ] Got command RPT from MCS: ref #845075
2018-12-15 13:10:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 13:10:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845075  12 58467 47420553 A  ERRORB˜™š'
2018-12-15 13:10:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 13:10:54 [DEBUG   ] Got command RPT from MCS: ref #845080
2018-12-15 13:10:54 [DEBUG   ] summary = ERROR
2018-12-15 13:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845080  13 58467 47454901 A  ERRORERROR'
2018-12-15 13:10:54 [DEBUG   ] Got command RPT from MCS: ref #845081
2018-12-15 13:10:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:10:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845081  77 58467 47454902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:10:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-12-15 13:11:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-12-15 13:11:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:11:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:11:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:11:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:11:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:11:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:11:16 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-12-15 13:11:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 13:11:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 13:11:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 13:12:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:12:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:12:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:12:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:12:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:12:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:12:16 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-12-15 13:12:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 13:12:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 13:12:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 13:13:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:13:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:13:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:13:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:13:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:13:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:13:16 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-12-15 13:13:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 13:13:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 13:13:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 13:14:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:14:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:14:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:14:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:14:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:14:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:14:16 [DEBUG   ] Finished updating board flags in 1.475 seconds
2018-12-15 13:14:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 13:14:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 13:14:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 13:15:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:15:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:15:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:15:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:15:16 [WARNING ] (13, 1, 'bot')
2018-12-15 13:15:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:15:16 [DEBUG   ] Finished updating board flags in 1.478 seconds
2018-12-15 13:15:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-12-15 13:15:19 [DEBUG   ] Got command RPT from MCS: ref #845105
2018-12-15 13:15:19 [DEBUG   ] summary = ERROR
2018-12-15 13:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845105  13 58467 47719833 A  ERRORERROR'
2018-12-15 13:15:20 [DEBUG   ] Got command RPT from MCS: ref #845106
2018-12-15 13:15:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:15:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845106  77 58467 47720037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:15:20 [DEBUG   ] Got command RPT from MCS: ref #845107
2018-12-15 13:15:20 [DEBUG   ] summary = ERROR
2018-12-15 13:15:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845107  13 58467 47720241 A  ERRORERROR'
2018-12-15 13:15:20 [DEBUG   ] Got command RPT from MCS: ref #845108
2018-12-15 13:15:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:15:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845108  77 58467 47720433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:15:20 [DEBUG   ] Got command RPT from MCS: ref #845109
2018-12-15 13:15:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 13:15:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845109  12 58467 47720637 A  ERRORB™™š'
2018-12-15 13:15:38 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-12-15 13:15:54 [DEBUG   ] Got command RPT from MCS: ref #845110
2018-12-15 13:15:54 [DEBUG   ] summary = ERROR
2018-12-15 13:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845110  13 58467 47754897 A  ERRORERROR'
2018-12-15 13:15:54 [DEBUG   ] Got command RPT from MCS: ref #845111
2018-12-15 13:15:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:15:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845111  77 58467 47754898 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:15:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 13:16:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:16:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:16:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:16:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:16:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:16:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:16:17 [DEBUG   ] Finished updating board flags in 2.247 seconds
2018-12-15 13:16:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 13:16:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 13:16:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 13:17:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:17:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:17:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:17:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:17:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:17:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:17:17 [DEBUG   ] Finished updating board flags in 2.255 seconds
2018-12-15 13:17:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 13:17:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 13:17:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-12-15 13:18:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:18:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:18:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:18:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:18:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:18:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:18:17 [DEBUG   ] Finished updating board flags in 2.262 seconds
2018-12-15 13:18:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 13:18:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-12-15 13:18:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 13:19:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:19:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:19:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:19:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:19:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:19:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:19:17 [DEBUG   ] Finished updating board flags in 2.070 seconds
2018-12-15 13:19:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 13:19:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 13:19:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 13:20:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:20:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:20:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:20:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:20:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:20:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:20:17 [DEBUG   ] Finished updating board flags in 2.035 seconds
2018-12-15 13:20:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-12-15 13:20:19 [DEBUG   ] Got command RPT from MCS: ref #845133
2018-12-15 13:20:19 [DEBUG   ] summary = ERROR
2018-12-15 13:20:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845133  13 58467 48019913 A  ERRORERROR'
2018-12-15 13:20:20 [DEBUG   ] Got command RPT from MCS: ref #845134
2018-12-15 13:20:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:20:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845134  77 58467 48020117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:20:20 [DEBUG   ] Got command RPT from MCS: ref #845135
2018-12-15 13:20:20 [DEBUG   ] summary = ERROR
2018-12-15 13:20:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845135  13 58467 48020321 A  ERRORERROR'
2018-12-15 13:20:20 [DEBUG   ] Got command RPT from MCS: ref #845137
2018-12-15 13:20:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:20:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845137  77 58467 48020525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:20:20 [DEBUG   ] Got command RPT from MCS: ref #845138
2018-12-15 13:20:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-12-15 13:20:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845138  12 58467 48020717 A  ERRORB˜™š'
2018-12-15 13:20:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-12-15 13:20:54 [DEBUG   ] Got command RPT from MCS: ref #845147
2018-12-15 13:20:54 [DEBUG   ] summary = ERROR
2018-12-15 13:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845147  13 58467 48054905 A  ERRORERROR'
2018-12-15 13:20:54 [DEBUG   ] Got command RPT from MCS: ref #845148
2018-12-15 13:20:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-12-15 13:20:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   845148  77 58467 48054906 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-12-15 13:20:58 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-12-15 13:21:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:21:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 13:21:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:21:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:21:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:21:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:21:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:21:17 [DEBUG   ] Finished updating board flags in 1.937 seconds
2018-12-15 13:21:18 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-12-15 13:21:39 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-12-15 13:21:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-12-15 13:22:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:22:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:22:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:22:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:22:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:22:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:22:17 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-12-15 13:22:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 13:22:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 13:22:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-12-15 13:23:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:23:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-12-15 13:23:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:23:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:23:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:23:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:23:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:23:17 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-12-15 13:23:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 13:23:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-12-15 13:23:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-12-15 13:24:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-12-15 13:24:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:24:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:24:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:24:17 [WARNING ] (13, 1, 'bot')
2018-12-15 13:24:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-12-15 13:24:17 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-12-15 13:24:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 13:24:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-12-15 13:24:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
